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INTRODUCTION 



Problem 



The education of visually impaired children has been hampered by slow methods 
of material presentation. Since use of the tactile and auditory senses is 
not as efficient as normal sight, visually impaired children require a longer 
period of time to acquire information equal in amount to that of their seeing 
contemporaries. Visually impaired individuals read in braille, large type or 
through auditory means at slower rates than normally sighted individuals read 
print. While the sighted student can read about 250 words per minute (wpm) , 
the braille reader averages about 90 words per minute. 

A number of attempts have been made to remedy the problem of the relatively 
slow rate of material presentation for blind students. One attempt has been 
recording information to be learned on discs or tapes. This technique has 
alleviated the problem to some extent in that the characteristic speaking rate 
of a professional reader is approximately 175 wpm. However, this rate still 
compares unfavorably with the 250 wpm speed of the average sighted reader .> 

The disadvantage is especially evident when one considers that comparable 
levels of comprehension may be attained at rates more rapid than 175 wpm. 

The fact that comprehension is comparable at rates faster than the recorded 
rate has led to another approach to the problems speeding up the rate of 
aural material presentation. Presently, there are two such methods. The 
first method requires the recording to be played at a speed faster than it 
was originally recorded. The second method utilizes an electronic time com- 
pression technique in which segments of speech are discarded » None of the dis- 
carded segments is large enough to destroy the intelligibility of a speech 
element. By using this technique, it is possible to compress sound up to at 
least 50 percent and still have it remain intelligible. 

There is little doubt that the above techniques result in an increase in the 
rate of information input; however, both rely solely on the auditory sense. 
While earlier research studies were concerned with factors such as braille 
size, spacing, and contractions, no research has investigated the feasibility 
of altering braille materials for the purpose of increasing information input 
via the tactile sense. One of the advantages possessed by normally sighted 
individuals is that they may learn to scan and thus not attend to unimportant 
words, phrases, and sentences. Unfortunately, touch perception in braille 
reading does not lend itself well to rapid scanning techniques. Therefore, 
if the rate of information input is to be markedly increased via braille, elim- 
ination of certain materials becomes necessary. 

In the formulation of this research project, it was assumed that typical 
textual material could be rewritten in such a fashion that low information 
words, phrases, and sentences could be eliminated without destroying the 
essential information contained in the paragraph. The objective of such elim- 
ination was to arrive at a set of materials which, though highly abbreviated 
and condensed, would contain all essential information. Such telegraphic 
materials would provide the reader with the important informational units and 
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at the same time, achieve an economy of description and narration. 

Following is a sample illustrating how material may be substantially reduced 
when high information words are retained, extraneo'.;s words eliminated, and 
information rearranged. This passage discusses an early phase of 
Canadian history. 



A. Typical Text 

0$ 

The first Europeans to visit the shores of Canada were, far as 
we know, the Northmen. These daring seafarers found their way to 
the northeast coast of North America, by way of Greenland, about 
the year 1000. Their visits, however, left no trace behind^ and 
for practical purposes the discoverer of Canada was John Cabot, 
an Italian merchant-sailor in the service of the king, Henry VII 
of England, who sailed from Bristol and touched at what is now 
Canadian soil in lA97--a year before Columbus reached the South 
American mainland on his third voyage. Cr^bot, like Columbus, was 
in search of a sea-route to Asia; and when he did not find on the 
bleak coast of North America the oriental silks and spices which 
he sought, he was bitterly disappointed. But though he did not 
find silks and spices, he found something no less prof itable--the 
fish off the banks of Newfoundland. His son Sebastian, on his 
return to Europe, went so far as to report that the codfish were 
so numerous "they sumtymes stayed his shippes." As a result, 
fishermen from European ports began to come out to the banks of 
Newfoundland and established a permanent link. 

B. Telegraphic Text 

Northmen 

First Europeans to visit shores of Canada 
Came by way of Greenland around 1000 
Their visit left no trace behind 

John Cabot 

Italian merchant 

Sailor in the service of Henry VII of England 
Sailed from Bristol and reached Canadian soil in 1A97 
Like Columbus, in search of a sea-route to Asia 
Was disappointed when he didn't find oriental silks and spices, 
but his son, Sebastian, reported seeing numerous codfish 
which led to European fishermen coming to Newfoundland 

While the typical text contains approximately 200 words, the telegraphic 
version contains just 79 words. This represents a reduction of 3/5 of the 
original text. 

The basic question examined in this study is whether braille material 
presented in telegraphic style can be learned as effectively as material 
presented in a conventional style. It may be hypothesized that students 
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do not require the superfluous words of each sentence to convey meaning 
when the important relevant information is present. In fact the rearrange- 
ment and omissions of certain low-information words, phrases, and sentences 
in typical contextual material may serve to increase the extent to which 
material is learned and retained. The basic purpose of this research is to 
determine whether high informational, condensed materials are as effective, 
if not more effective, than conventional full-text materials. It is this 
problem to which this research is addressed. 

Related Research 



The possibility of developing telegraphic materials was based upon the 
assumption that written and spoken language contains many words and word 
sequences which are unnecessary for the comprehension of a message. That 
is, in the usual message, there are words, phrases, and sometimes even 
sentences which add no further information. In information theory jargon, 
language is not particularly efficient in that there is a great deal of 
sequential dependencies, or redundancy. Although the measurement of redun- 
dancy is possible with artificial laboratory stimulus materials, it is prac- 
tically impossible to obtain a direct measurement of redundancy in printed 
English. 

The fact that redundancy is present in language and that subjects are aware 
of this redundancy has been demonstrated in a number of ways. Garner (1962) 
presents an excellent summary of this research. Although the research is 
not directly related to this project, it does provide some support for the 
possible feasibility of telegraphic materials. One way in which redundancy 
has been demonstrated is by subjects' ability to replace missing letters in 
words. The first demonstration of this fact was provided by Chapanis (1954) . 
Ee selected several prose passages differing in difficulty. The essential 
aspect of this experiment involved deleting 1/10, 1/5, 1/4, 1/3, 1/2, and 
2/3 of the letters on either a random or regular deletion basis. The results 
indicated that with regular 20 percent deletion approximately 90 percent of 
the missing letters were correctly restored. However, as percentage of 
deletion increased, accuracy fell off quite rapidly. When 50 percent of the 
text had been deleted, only about 10 percent of the text could be correctly 
restored. Another interesting finding was that in those passages where re- 
dundancy was low, difficulty in reconstructing them was great. In a similar 
experiment. Miller and Friedman (1957) replicated the Chapanis' results. 
Furthermore, they found that when they deleted and abbreviated all the vowels 
and spaces (resulting in 48 percent abbraviation) , their subjects were able 
to produce 93 percent of the missing elements. Garner, in commenting on 
these results, suggests that the Miller and Friedman abbreviation technique 
comes close to providing an efficient method of recoding:<English without a 
corresponding loss in intelligibility. 

While a relatively large percentage of letters can be deleted without an 
appreciable loss in intelligibility, the percentage is not as great with 
words. Morrison and Black (1957) required their subjects to replace missing 
words in sentences containing 1 to 6 deletions per sentence. The striking 
aspect of their results was that when a single word was deleted from a 




3 



senttnce, accuracy in replacing it was no greater than 50 percent. Similar 
results have also been obtained by Aborn, Rubenstein, and Sterling (1959).. 

In fact, these results indicated that overall accuracy of replacement was 
approximately 40 percent. 

While the word replacement data appear to cast some doubt on subjects' 
ability to replace deleted words from prose passages, data obtained by 
Aborn and Rubenstein (1958) illustrate the nature of their problem. In 
addition to the replacement task, these investigators required their subjects 
to write down eight different words which could be used to replace the 
deleted word. The results indicated that the subjects had little difficulty 
in finding eight different words to use in place of the deleted word. Even 
though subjects experienced difficulty in predicting the exact deleted word, 
they were able to supply a word which made the sentence meaningful. 

The preceding studies illustrate the fact that redundancy is a feature of 
language. Because of the sequential dependencies in language, subjects are 
able to replace missing letters and words with a fair degree of accuracy. 
However, none of these studies has investigated the effect of deletion upon 
comprehension of the passagej even though subjects were able to replace 
missing elements with a fair degree of accuracy, evidence of comprehension was 
not obtained. Yet, the preceding studies provide a rationale for the feasi- 
bility of telegraphic materials. 

The most important aspect of telegraphic materials is the elimination of non- 
essential information. Therefore, if a blind child were to maintain the 
same reading rate with telegraphic materials as with traditional materials, 
the rate of information input would be increased. The fact that rate of 
information input can be increased without appreciable loss in comprehension 
has been demonstrated in the compressed speech studies. 

One of the earliest studies investigating the relationship between amount of 
time compression and comprehension of connected speech was conducted by Fair- 
banks, Guttman and Myron (1957). These investigators presented two different 
technical messages at five different time compression levels (0, 30, 50, 60, 
and 10%) to Air Force Trainees. The 0, 30, 50, 60, and 70% compression levels 
correspond to wpm rates of 141, 201, 282, 353, and 470 respectively. The 
results indicated that message efficiency, as measured by the amount of 
factual comprehension (multiple-choice items) per stimulus time, increased 
up to a message rate of 282 wpm. That is, when compared to the comprehension 
of the 141 wpm passage (0% compression), the 282 wpm comprehension was 90% 
effective. The 353 and 370 wpm rates were 70 and 41% effective respectively. 
Thus, these results indicate that there is little loss in comprehension up 
to and including the 282 wpm rate. However, there is a rather marked de- 
crease in comprehension at the faster rates. 

Similar results have been obtained by Faulke, Amster, Noxan and Bixler (1962). 
These investigators presented literary and scientific passages to sixth, 
seventh and eighth grade braille readers in braille and recorded form. The 
material was recorded at 175, 225, 275, 325, and 375 wpm. Comprehension of 
these materials was assessed by multiple choice items. Comparison of mean 
comprehension scores for each listening group with comprehension scores for 
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bralll6 readers indicated no significant loss in comprehension of the liter- 
ary material up through 225 wpm. For the scientific material, there was no 
significant loss up through 275 wpm. However, when the faster rates were 
compared to the braille condition, there was a significant loss in comprehen- 
sion. It appears that comprehension is impaired when the rates approach or 
exceed 300 wpm. 

A more recent study by Faulke (1966) also indicates that comprehension is 
seriously affected at faster rates. The word rates studied in this experi- 
ment were 253, 300, and 350 wpm. In addition, two different methods of 
compressing speech were examined. While there was no difference in compre- 
hension as a function of the two speech compression methods, there was a 
significant difference among the word rates. No post-mortem analyses were 
performed to determine which rates were different, but the mean comprehen- 
sion scores for the 350 wpm groups were approximately one-half as large as 
the 253 wpm groups (12.80 and 10.36 for the 350 wpm groups compared to 23.65 
and 21.19 for the 253 wpm groups). 

The time compression studies demonstrate the fact that the auditory communi • 
cation rate can be increased up to approximately 275 wpm without an appreci- 
able loss in comprehension. These studies clearly indicate that subjects 
are able to process information via the auditory modality at rates faster 
than the ones encountered under normal conditions. These data, plus the 
redundancy data, suggest that more efficient methods of material presentation 
may be possible via the tactile modality. However, relatively little atten- 
tion has been given to this problem as it relates to the preparation of 
braille materials. 

A major problem which arises in any attempt to vary redundancy in meaningful 
prose passages is one of measurement. As previously mentioned, such measure- 
ment is possible with artificial laboratory materials but is practically 
impossible with meaningful materials. However, Dawes (1964) has developed a 
method which provides the basis for defining the essential structure of 
prose material. Because the method itself is artificial, it is difficult 
to analyze existing prose material. But it does provide a basis for opera- 
tionally defining the essential information in artificially constructed 
meaningful material. With this method, it is possible to keep the amount of 
essential information constant among different types of specially constructed 
prose passages. 

The essential feature of Dawes' model is the definition of the structure of 
prose material in terms of set relations. With this model it is possible to 
diagram the essential structure of a specially designed passage by the use 
of Venn diagrams. Dawes (1964) constructed a story about an imaginary island 
in the middle of the Atlantic. The people of the island had always been 
faced with a water shortage. Farming and cattle ranching were the main 
occupations. However, none of the ranchers engaged in farming, nor did any 
of the farmers engage in ranching. This information can be diagrammed as 
two exclusive sets. These two sets are presented in Figure 1. 
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Figure: 1, Diagram of two exclusive ieta« 



lh»? itory indliatfei that the Island is governed by a 10-man senate com- 
posed entirely of ranchers, Ihus, senators is a sub-set of ranchers. 
Figure. 2 presents this relationship. 




Figure 2, Diagram >i a nested set. 



Because senators are a sub-set within the set of all ranchers, this rela- 
tionship is referred to as a nested relationship. 

The story also tells of a pro-canal association which was formed by some 
of the farmers and a few of the senators. Thus, the pro-canal association 
is represented by an overlapping set of some senators and some farmers. 
Figure 3 presents this relationship. 
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Figure 3. Diagram of a disjunctive set. 



Sub-set D is referred to as a disjunctive relation because it contains ele- 
ments which are common to both A and B. The final set in the story involved 
those islanders who voted for the idea of constructing a canal. This set 
is labeled the pro-voters and consists of all members of the pro-panal 
association and all farmers. Figure 4 represents in Venn diagram form the 
structure of the story. 



Figure 4. 




Diagrammatic representation of the structure of Dawes' 



Story 1.^ 



Although most prose material is not amenable to a set relation analysis, the 
Dawes' model does permit one to construct a passage whose structure is 
definable in terms of nested and disjunctive relationships. Therefore, it 
is possible to develop prose materials Which vary with respect to the amount 
of nonessential information contained in them. Essential information is 
defined as materials which describe the set relations. This model also 
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after Dawes 



(1964). 
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permits one to keep the amount of essential information constant among 
various prose passages. 

A second feature of this model is that it allows one to test the compre- 
hension of some rather complex relationships. Dawes postulates two types of 
errors possible in the recall of the set relations. If in the recall of 
a nested set such as the one presented in Figure 2, a subject recalls set C 
as overlapping or disjunctive with sets A and B, then the subject has made 
a pseudo-discrimination error; that is, he has made a discrimination when 
in fact there was none. On the other hand, a subject may fail to recall a 
discrimination that was present in the passage, as in Figure 3, not recalling 
that some farmers, some ranchers, and some senators belonged to the pro- 
canal association. Or, if a subject fails to recall that some, rather than 
all or no members of a set were included in another set, he is failing to 
make a discrimination where one in fact existed; such an error is termed 
an overgeneralization error. Thus, the model makes it possible to measure 
the comprehension of the two types of set relations. 

A third and rather interesting aspect of Dawes' study was the type of errors 
which were made in recall. As predicted, he found that overgeneralization 
errors were more common than pseudo-discrimination errors. The explanation 
which he offered for these findings was one of information overload. Since 
overgeneralization results in a reduction in the number of categories in 
the passage (e.g., in Figure 3, the subject fails to recall that a portion 
of set D is contained in sets B, C, and A) it reduces the amount of informa- 
tion contained in the passage. Pseudo-discrimination errors, on the other 
hand, produce an increase in amount of inforr ation. Because of the limita- 
tion in human memory, it was not surprising that Dawes' subjects made more 
overgeneralization than pseudo-discrimination errors. 

Dawes' model not only affords a technique for holding the amount of essen- 
tial information constant across the three versions, it also provides a 
basis for comparing the telegraphic and traditional passages on the type of 
recall errors made. Assuming that overgeneralization errors occur as a 
result of information overload and since the shorter passages contain less 
information, the model may be interpreted as predicting proportionately 
fewer overgeneralization errors in the telegraphic passages. Although all 
passages contain the same set relation material, they differ in the amount 
of extraneous material. It is the latter which increases the amount of 
total information in the passage and consequently may interfere with the 
recall of the basic set relations. Thus, analysis of the set relation 
recall errors may offer the opportunity of determining whether or not 
telegraphic materials make less imposition upon memory than traditional 
materials. 

While it is interesting to speculate on the type of set relation errors 
predicted by the Dawes' model in the recall of the traditional and telegraphic 
materials, this is not the major advantage of the model. The utility of 
this model is that it makes possible an operational definition of essential 
information, thereby permitting this information to be held constant across 
all versions. Furthermore, the model provides a method for directly 
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assessing the comprehension of the complex set relations. 

Ob jectives 

The general objective of this research was to determine the feasibility of 
presenting prose material in telegraphic form to visually handicapped 
children. The goal was to increase the rate of information input via braille 
in much the same manner as auditory information input has been increased via 
the time compression techniques. In attempting to accomplish this goal, 
low information words, phrases, and sentences were eliminated from more 
traditional prose materials, thereby greatly reducing the total number of 
braille characters in the telegraphic passages. To study the feasibility 
of telegraphic materials, the following specific tasks were involved: 

1. Preparation of brailled learning materials . To insure that the subjects 
would be unfamiliar with the materials, a fictional story concerning two 
\ 7 arring African nations was written in traditional prose form. The content 
of the story provided for an analysis of the essential information in terms 
of the Dawes' model; the central ideas of the passage were the set rela- 
tions. Then a telegraphic version of the story was prepared using a tra- 
ditional sentence and paragraph form in which narrative and background 
material was reduced A27o. Finally, a short, telegraphic version written 
not in sentence and paragraph form but in a form resembling a telegram, 
permitted a 72% reduction of the original passage. While there was a 
marked reduction in the total number of words in the two styles of telegra- 
phic passages, the essential information pertaining to the set relations was 
the same in all three versions. 

2. Assessment of comprehension . Three different methods of measuring 
comprehension were developed to provide a broader basis upon which to evalu- 
ate the relative effectiveness of the three treatment versions. 

a. Multiple-choice items. Thirty-nine multiple choice items were con- 
structed from the traditional prose version. Twenty-three of these 
items could be answered from all three of the treatment versions. 

The remaining sixteen items could not be answered on the basis of 
the information provided in either or both of the telegraphic 
versions. It was assumed that this method of measuring compre- 
hension most closely approximated the typical methods used in 

the classroom. 

b. Set relation items. This method of assessing comprehension had 
two potential advantages. One advantage was that these items 
afforded an opportunity to measure the comprehension of the com- 
plex set relations presented in the three treatment versions. It 
was assumed that these items demanded the recall of more complex in- 
formation than that demanded by the multiple choice items. A 
second advantage of the set relation items was that they offered 

an opportunity to evaluate more specific features of the three 
prose passages. In particular, since the Dawes' model assumes 
overgeneralization errors to be due to memory limitations, and 
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since the telegraphic versions were designed to reduce the amount 
of extraneous information, it was predicted that proportionately 
fewer overgeneralization errors would occur in the telegraphic 
versions than in the traditional version, 

c. Reconstruction task. The third method of assessing comprehension 
required the subjects to prepare a written reconstruction of as 
much of the original passage as they could recall. While this 
type of task posed some scoring problems, it does represent the 
type of situation often encountered in essay-type tests. Further- 
more, it permitted a comparative analysis of the writing style of 
the subjects receiving the three different versions. More 
specifically, it was possible to determine whether subjects receiv- 
ing the telegraphic versions tended to write their reconstructions 
in a telegraphic style. 

3. Assessment of long-term retention . In order to determine the effects 
of the three versions on long term retention, the above recall tasks were 
administered again one week after original reading of the passages. The 
delayed retention interval made it possible to determine whether there was 
an interaction between the three treatment versions and the two retention 
intervals. 
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METHOD 



Subjects 



The subjects were 210 sixth, seventh, eighth and ninth grade students. Of 
this total, 198 of the subjects attended state residential and day care 
schools for the blind: the Michigan School for the Blind, Lansing, Michigan, 

(83 subjects); the Indiana School for the Blind, Indianapolis, Indiana, 

(44 subjects); and the State School for the Blind, Columbus, Ohio, (71 sub- 
jects). The remaining 12 subjects attended public schools in Oakland County, 
Michigan. All subjects had received formal braille instruction for four 
years or more. None of the subjects was informed of the nature of the study. 



Basic Structure of the Three Treatment Versions: The construction of the 

set relations framework . One-third of the subjects read a traditional pas- 
sage, one- third read a medium length telegraphic version, and one-third 
read a short telegraphic version. The full text of each version appears in 
Appendices A, B, and C. 

The three versions contained the same essential information. The same se- 
quence of events was maintained and the same persons and groups of persons 
were identified in all three versions. Most important, the changing rela- 
tionships among the groups during the course of events were systematically 
maintained in all three versions. These relationships constituted the politi- 
cal structure of the two warring African nations, Mambo and Yam, and provided 
the essential framework upon which all versions were based. Figure 5 illus- 
trates the two types of nested and disjunctive relations that were described 
before the battle, and Figure 6 illustrates the relations after the battle. 

Both diagrams contain the same number of sets and maintain the same basic 
relationships. However, the labels of some of the sets change as a result 
of the changes in the political structure of the two nations. 

Readability . The three treatment versions were constructed so that the read- 
ability indices were comparable. The Dale-Chall formula (1948) was used to 
compute a readability index for each treatment version. The traditional 
version had a formula raw score of 6.67, the medium telegraphic version a 
formula raw score of 6.82, and the short telegraphic version a formula raw 
score of 6.76. According to the correction table constructed by Dale and 
Chall, socres in the 6.0-6. 9 range indicate reading material that can be read 
with understanding by average children in grades seven and eight. While the 
material might have been somewhat more difficult for the sixth grade subjects 
and somewhat easier for the ninth grade subjects, these subjects were equally 
distributed in the nine experimental groups. 

The process of reducing prose length: Style . The traditional version was 

written first and then extraneous words, phrases and sentences were elimin- 
ated in order to produce the medium and short telegraphic versions. 



Materials 
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Area Surrounded by Dashes = Lester Followers; Shaded Area « Pro Lester Union 

Nested Relations 

All expert warriors are Mambos 
All merchants are Yams 
All Yams are Lester Followers 
All merchants are Lester Followers 

All members of the Pro Lester Union are Lester Followers 

Disjunctive Relations 

Some Mambos are Lester Followers 

Some expert warriors are Lester Followers 

Some Mambos are members of the Pro Lester Union 

Some expert warriors are members of the Pro Lester Union 

Some merchants are members of the Pro Lester Union 

Some Yams are members of the Pro Lester Union 

Figure 5. Set relations existing before the battle as described in all 
three treatment versivins. 



The narrative style of the traditional version (A) was one of the factors 
contributing to its greater length. Such phrases as "However j there is an 
interesting legend . . . "It is interesting to point out . . . as 

well as rhetorical questions such as "But what of Yam?", created a hypotheti- 
cal relationship between writer and reader not unlike the style of texts 
written for elementary and junior high school students. The medium tele- 
graphic version (B) did not include this type of material, nor did the short 
telegraphic version (C) . Also, versions A and B, the latter to a lesser 
extent, presented background material about such matters as time of day an 
event took place, the moods of the persons participating in the story, the 
possible reasons for an action taken, and comparisons to other times. 
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Area Surrounded by Dashes = Slaves; Shaded Area = Freedom Group 

Nested Relations 

All expert warriors are Mambos 

All legend believers are slaves 

All Yams are slaves 

All Legend Believers are Yams 

All members of the Freedom Group are slaves 

Disjunctive Relations 

Some members of the Freedom Group are Mambos 

Some members of the Freedom Group are Yams 

Some members of the Freedom Group are Legend Believers 

Some members of the Freedom Group are expert warriors 

Some Mambos are slaves 

Some expert warriors are slaves 

Figure 6. Set relations existing after the battle as described in all 
three treatment versions. 




As a result of its lack of narrative phraseology and extra background materi- 
al, version C, when compared to versions A and B, also had a markedly smaller 
number of repetitions of key content words. The number of content words re- 
peated after once having been used in a given version is 3AA for the version 
A, 277 for the version B and 116 for version C. In other words, the use of 
the narrative and background material resulted in a concomitant repitition of 
the content words so that the reader of version A read approximately three 
times as many repeated content words than the reader of version C. Table 1 
presents the distribution of the number of content words in the three versions. 
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Table 1. Distribution of the number of content words in the three versions. 





A 


Version 

B 


C 



Different Content Words 


310 


210 


152 


Content Words Used Repetitively 


344 


277 


116 


Other Words 


966 


460 


187 


Total 


1620 


947 


455 



Sentence structure changes in the reduction process; Grammar, punctuation 
and indentation . Although versions A and B differed in narrational and back- 
ground material, they were essentially alike in sentence structure. The C 
version, however, varied considerably from the conventions of ordinary 
English usage. It contained a total of 32 sentences (a sentence is defined 
here as a string of words beginning with a capital letter which follows a 
period and is terminated by a period). Four of these sentences lacked either 
a subject pronoun or noun, or a complete verb form in the predicate, because 
the words themselves were predictable from the remaining words in the sentence 
and were therefore considered to be redundant. Sentences in version C were 
also shorter (1A.2 words per sentence) than sentences in either version A or 
B (17.4 and 17.5 words per sentence respectively). This words-per-sentence 
reduction was in part due to the use of colons and semi-colons as substitu- 
tions for unnecessary words. For example, in the sentence from version C, 
"Yam: Ruled by rich, handsome King Lester, loved by his subjects," the word 

"was" was replaced by a colon. 

The final length of the three versions was: A, 1620 words; B, 947 words: 

C, 455 words. The latter reduction was accomplished by the elimination 
of some whole sentences present in the A version a well as the B version. 
Virtually none of the sentences of the C version was identical to the sen- 
tences in the A or B versions. The elimination of words considered to be 
unnecessary to the understanding of the basic facts of the story permitted 
the combining of selected sentences and phrases, exemplified on the follow- 
ing page. In this example, the word "continent" has been eliminated as 
information that is not necessary to establish the two important sets, 
the Mambos and the Yams. The redundant use of "nation" and "two" in version 
A has been partially eliminated in version B and wholly eliminated in 
version C. 
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Version A 



Version B Version C 



In the year 1800 on 
the continent of Africa, 
two unfriendly nations ex- 
isted, the nation of Mambo 
and the nation of Yam. The 
Nile River separated these 
two nations. 

This reduction procedure had little effect on the relative numbers of vari- 
ous parts of speech in each story with the exception of the number of definite 
and indefinite articles. The ratio of articles to all other parts of speech 
is .09 for versions A and B and .02 for version C. This resulted from the 
deliberate elimination of "a's" and "the's" in the latter wherever possible. 
Table 2 presents the numbers of the 13 parts of speech contained in the 
three versions. 



In the year 1800 on 
the continent of Africa, 
two unfriendly nations ex- 
isted, Mambo and Yam. The 
Nile River separated them. 



In Africa, in 
1800, the Nile Riv- 
er separated two 
unfriendly nations, 
Mambo and Yam. 



Table 2. Numbers of 13 parts of 


speech in the 


three versions. 






Parts of Speech 


A 


Version 

B 


C 



Nouns 


409 


256 


141 


Verbs 


233 


141 


73 


Adjectives 


175 


81 


73 


Prepositions 


148 


93 


41 


Articles 


136 


76 


8 


Conjunctions 


106 


70 


31 


Pronouns 


105 


39 


10 


Adverbs 


80 


25 


16 


Negatives 


70 


56 


31 


Noun Modifiers 


34 


27 


12 


Possessive Nouns 


14 


11 


6 


Possessive Pronouns 


13 


11 


8 


Expletives 


2 


0 


1 



The physical arrangement of version C permitted further revision into uncon- 
ventional sentence patterns. Sentences following a sentence which introduced 
an important new person, group or event were indented beneath the introduc- 
tory topic sentences, as follows; 



Version A 



Version B 



Version C 



King Koko prepared 
his army for war and the 
most important preparation 
was the worship of Solmambo, 
the sun-god. 



King Koko prepared 
his army for war and the 
most important was the 
worship of Solmambo, the 
sun-god. 



Koko prepared Mambo 
army for war by: 

first, worship of 
Solmambo, their 
sun-god. 



This type of physical arrangement made some types of subordination more 
obvious and permitted the elimination of other words and phrases. 

Procedure and design of the study . 

All subjects were assigned to one of the three treatment versions: 

Traditional (A), Medium Telegraphic (B) , and Short Telegraphic (C) . Subjects 
were assigned to the nine groups on the basis of age, IQ, and reading achieve- 
ment. The objective was to form groups which had comparable means and vari- 
ances on these three variables. However, for some subjects, information on 
all three variables was not available. For these subjects, assignment was 
based upon whatever information was available. The means, ranges, and stan- 
dard deviations for each of the nine groups on the three variables is pre- 
sented in Table 3. Three 1x9 analyses of variance were performed. The 
resulting F values were: .27 for age, .25 for IQ, and 1.02 for reading 

achievement. The results indicate that all nine groups were comparable on 
these three variables. 

Within each group assigned to a particular version, there were three sub- 
groups assigned to one of the three recall conditions: set relations (1), 

multiple choice (2), and reconstruction(3) . The general design of the study 
is illustrated as follows; 



TREATMENT VERSION 




RECALL CONDITION 






Set Relations(l) 


Multiple Choice(2) 


Recons t rue tion(3) 


Traditional (A) 


A-1 


A-2 


A-3 


Medium Telegraphic (B) 


B-1 


B-2 


B-3 


Short Telegraphic (C) 


C-1 


C-2 


C-3 



Recall was measured immediately after reading the assigned version and again 
one week later without rereading the passage. Each subject was retested in 
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the same recall condition as the one originally assigned. 

The actual testing was conducted in all participating schools during the 
period from September, 1966 to Tebruary, 1967. 

Attenuation of subjects . Sixteen subjects were eliminated because they did not 
complete the recall test materials in the allotted time. Nine additional 
subjects who were absent from either the first or second recall session and 
five subjects who failed to follow instructions were also eliminated. 

Because a total of thirty subjects was eliminated for the above reasons, it 
was decided to retain a subject's responses to the multiple choice items if 
he had completed at least thirty of the thirty-nine items in the first ses- 
sion. However, if a subject completed fewer than thirty items during the 
first testing session, neither his first nor second session responses was 
retained and he was eliminated from the study. 

No similar decision was necessary for the subjects in the other two recall 
conditions . 

Table 4 presents the number of subjects eliminated and retained in each of 
the nine experimental groups. A total of 14 subjects was eliminated from the 
traditional groups, 7 from the medium telegraphic groups and 9 from the short 
telegraphic groups. 

The three recall conditions; Set Relations . This recall condition was spe- 
cif icalTy~design^d~to”lneasure~~subj|ects'*~r^ent ion and distortion of the set 
relations. The test consisted of 20 items, 10 of which were concerned with 
nested relationships and 10 items with disjunctive relationships. Each item 
required the subject to circle the true statement from a pair of statements 
presented in braille, i . e . . "all of the expert warriors belong to the Pro 
Lester Union," or "only some of the expert warriors belonged to the Pro 
Lester Union." Half of the nested and half of the disjunctive items pertain- 
ed to relationships as they were described before the battle and half of each 
type pertained to events after the battle. The set relations test is pre- 
sented in Appendix D. 

Multiple Choice . This test consisted of 39 four-alternative multiple choice 
items based on the important events, setting, and people in the story. The 
primary purpose of this test was to test retention of factual type informa- 
tion. 

Both the set relations and multiple choice tests were printed in braille and 
attached to the story booklets. Braille answer sheets were separate. The 
subjects were instructed to circle their choice on the braille answer sheets. 
The multiple choice test is presented in Appendix E. 

Reconstruction . In this recall condition, subjects were instructed to recon- 
struct the story from memory. They were asked to use sentences and para- 
graphs, and to follow the original sequence of the story as closely as 
possible. Subjects wrote their reconstructions using slates and styli or 
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Table 4. Elimination and retention of subjects according to school attended 
and experimental group. 



School 

Experimental Group Michigan Indiana Ohio Oakland Total 



A-1 (Traditional-Set Relations) 



Eliminated: 


1 


1 


2 


1 


5 


Retained: 


9 


2 


5 


3 


19 


A-2 (Traditional-Multiple Choice) 


Eliminated: 


1 


0 


5 


0 


6 


Retained: 


8 


6 


2 


3 


19 


A-3 (Traditional-Reconstruction) 


Eliminated: 


2 


0 


1 


0 


3 


Retained: 


9 


2 


9 


0 


20 


B-1 (Medium Telegraphic-Set Relations) 


Eliminated: 


1 


0 


0 


0 


1 


Retained: 


7 


4 


11 


0 


22 


B-2 (Medium Telegraphic-Multiple Choice) 


Eliminated: 


1 


1 


2 


0 


4 


Retained: 


4 


7 


6 


0 


17 


B-3 (Medium Telegraphic-Reconstruction) 


Eliminated: 


1 


0 


1 


0 


l 


Retained: 


8 


5 


7 


0 


20 


C-1 (Short Telegraphic-Set Relations) 


Eliminated: 


1 


0 


0 


U 


i 


Retained: 


9 


6 


7 


0 


22 


C-2 (Short Telegraphic-Multiple Choice) 

Eliminated: 


2 


0 


2 


0 


4 


Retained: 


8 


7 


6 


0 


21 


C-3 (Short Telegraphic-Reconstruction) 


Eliminated: 


3 


0 


1 


0 


4 


Retained: 


8 


3 


4 


5 


20 


Total Subjects Eliminated: 


13 


2 


14 


1 


30 


Total Subjects Retained: 


.70 


42 


57 


11 


180 


Total : 


83 


44 


71 


12 


210 
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braillers. Their stories were later transcribed to print formed by a trained 
braille instructor. 

Immediate and delayed recall sessions . A group testing procedure was used in 
both the immediate and delayed recall sessions. The size of the groups 
ranged between 10 and 25 subjects. They were brought from their classrooms 
to a room specifically provided for the experimental sessions. The adminis- 
tration of the reading and retention tasks was supervised by A or 5 monitors. 

The instructions were read aloud to the group of subjects as they followed 
the same instructions printed in their braille test booklets. The instruc- 
tions were: 

We would like you to read carefully the following short story. 

After reading it, each of you will be tested for what you remember 
in different ways. Some of you will be asked to answer questions 
and some will be asked to tell all you remember about the story, 
so don't pay attention to what the parson next to you is doing. 

For those of you who are asked to write the story, we want you to 
write in sentence and paragraph (not outline) form, and to follow 
the original sequence as closely as you can. Do not turn the 
page until you are told to do so. Are there any questions? 

Subjects were then told to begin and monitors recorded the starting time. 
Subjects were permitted to ask for help with unfamiliar words. The last sen- 
tence in all three versions instructed the subjects to raise their hands. A 
monitor then went immediately to the subject, recorded the time elapsed since 
the signal to begin, and then asked the subject to read the instructions pre- 
ceding the assigned recall test. Subjects were self-paced in both the read- 
ing task and retention test. The 12 subjects from Oakland County, Michigan, 
were tested individually following the above procedure. 

Prior to session 2, subjects were not told they would be retested. The sec- 
ond recall session was conducted in the same manner as the first, with the 
recall tests given in the same room with the same group of subjects. However, 
the subjects were not given an opportunity to reread the story. The following 
instructions were read aloud as the subjects listened: 

Last week, after reading a short story, you were asked to indicate 
what you remembered of it. Some of you were asked to answer spe- 
cific questions and some of you retold the story in your own words. 

Today, we would like you to do the same as you did last week. You 
will not reread the story. For those of you who are asked to write 
the story, we want you to write in sentence and paragraph (not 
outline) form, and to follow the original sequence as closely as you 
can. 

Each subject was then administered the same recall condition administered to 
him in Session 1. 
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Scoring of Dependent Variables 



Set relations . The retention of the set relations was measured by (1) a to- 
tal items correct score and (2) a simplification score (s-score) which was 
defined as the number of nested items correct minus the number of disjunctive 
items correct. The s-score was divided into two subscores, one for the ten 
items based on before-the-battle set relations and ten items based on after- 
the-battle relations. 

Multiple choice . Three different scores were derived for this 39-item test; 
a score for total items correct, a score based on 23 items (common items) 
which could be answered from the information contained in all three treatment 
versions, and a third score for 16 items (non-common items) for which answers 
could only be inferred on the basis of information contained in the medium 
and short telegraphic versions. 

Reconstruction . Scoring of the immediate and delayed recall reconstructions 
was based upon the following dependent variables: 

1. Total words 

2. Total sentences 

3. Average words per sentence 

4. Total kernel sentences 

5. Total kernel sentences matching 

kernel sentences in treatment version A 

6. Total kernel sentences that are true inferences but not 

matches to kernel sentences in treatment version A 
7-19. Totals of each of 13 parts of speech 

20. Different key words 

21. Total key words 

22. Reading time 

For the most part, scoring of the reconstructions on total words, total sen- 
tences, and average words per sentence was fairly straightforward. However, 
due to lack of punctuation in some subjects' reconstructions, the length of 
the sentences had to be arbitrarily judged. 

Dependent variables 4, 5, and 6 resulted from a method of scoring subjects' 
reconstructions which was devised specifically for this project. The goal 
was the development of a methodology which would permit the specification of 
objective quantification rules whereby subjects' written recall of prose pas- 
sages could be evaluated. Any such method must yield reliable scoring units 
and must be amenable to different writing styles. In addition, the method 
must permit the separation of incorrectly recalled information from correctly 
recalled information. 

A simple count of the number of sentences failed to meet these criteria. The 
following sentences were extracted from subjects' reconstructions. 
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S-182 "King Lester was trying to. kill King Koko King Lester was ready 
to strike, but king Koko through the sword into his chest" 

S-184 "Near the end of the story, it was told how the King was killed 
in the Yam tribe, and how they lost their wealth, and how the 
people were taken as slaves." 

S-201 "King Lester was killed by King Koko." 

S-216 "Koko hit Yam in the chest with a sharp sword it came out of his 

back and he was dead." 

S-196 "He went up to King Koko and when he was just about ready to 

stick his weapon into the king. King Koko came up with his spear 
and put it through until it stuck out of his back." 

S-188 "Then King Koko saw King Lester and charged for him. King 

Lester tried to throw his spear, but it was too heavy for him. 

So King Koko killed King Lester." 

In S-182 's excerpt, the lack of punctuation produced obvious difficulties. 
Comparison of S-216 's sentence to S-196's sentence reveals further difficulty. 
The former contained errors of identification (Yam ?.s substituted for Lester, 
sword for spear). Another problem arose in connection with S-184' s sentence. 
Relevant information must be separated from irrelevant material such as "Near 
the end of the story it was told how." Still another problem arose when sen- 
tences of S-196 and S-188 were compared. They appeared to contain approxi- 
mately the same informration, but the style of writing and the number of sen- 
tences was different for the two passages. 

As a solution to these problems, the concept of the kernel sentence was em- 
ployed. By reducing the reconstructed stories to kernels, it was possible to 
separate correct information from incorrect, eliminate irrelevant material, 
and adjust for differences in style. 

Kernel sentences refer to simple, active, declarative sentences. The exact 
number of such distinct patterns existing in English is not agreed upon by 
linguists. However, for purposes of this study six patterns were sufficient. 
Any other sentence pattern could be shown to be a variation of one of these 
six. All patterns consist of a noun phrase plus a verb phrase. Words and 
word clusters within the noun and verb phrases fall into four word classes: 
noun, verb, adjective, and adverb. In Table 5 the six patterns used in the 
present analysis are shown with the form class labeled and examples from 
subjects' reconstructions presented. 

The kernel may be considered the basic information unit of spoken and written 
English (Roberts, 1956). Any sentence may be rewritten into one or more of 
the six basic kernels. Table 6 illustrates the rewrite procedure employed 
in transforming the original sentences into kernel elements. 
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Table 5. Six basic patterns of kernel sentences and examples of each pattern. 





Pattern 


Examples 





1. N V 

(Sub ject--Intransitive Verb) 



Lester fell. 
He died. 



2 . N V PD J 

(Subject- -Linking Verb--Predicate Adjective) 



Yam was richer. 
Lester seemed brave. 



3. Ni V Ni 

(Subject--Linking Verb--Predicate Noun) 



Koko was king. 
The Mambos were 
warriors . 



4. V N2 

(Sub ject--Transitive Verb--Direct Object) 



Koko planned war. 

The warriors trained 
merchants . 



5. 



Ni V N2 

(Subject--Transitive Verb--Indirect Object-- 

N3 

Direct Object) 



Koko gave Lester a 
jab. 

The warriors taught 
the merchants tricks. 



6. N V 

(Sub ject--Intransitive , Transitive or Linking 

ADV 

Verb- -Adverb) 



The battle lasted 
several hours. 
Koko paddled down 
the river. 



The following rewrite rules were developed to assist the judges in transform- 
ing the reconstructions into kernel form: 

1. Identify the noun phrases and verb phrases. 

2. Separate each noun phrase- -verb phrase pair from other such pairs which 
have been combined via coordination and/or subordination. 

3. Identify and label all the words and/or word clusters which are one of 
the four form classes, noun, verb, adjective, or adverb. 

4. Rewrite passive transformations into active form. 

5. Rewrite the question as a noun cluster functioning as the object of a 
statement. For example, "Koko asked, 'Will we win?"' is a pattern 
four kernel. 
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6. Rewrite adjective -noun pairs into kernels by supplying a linking verb be- 
tween the adjective and the word modified by it. When the same pair recurs 
in the same reconstruction, regard the pair as a unit. Do not rewrite 
into a separate kernel a second time. 

7. Include parenthetically any qualifying phrases which are not information- 
ally independent. For example, "He would become rich (if he defeated 
Yam)," is one kernel. 

8. Include as part of the sentence pattern simple phrases which operate as 
nouns, adjectives, or adverbs when these phrases are necessary to an in- 
formationally independent pattern. For example, "Koko paddled down the 
river," a pattern six kernel, contains the cluster "down the river." In 
"Yam warriors were no match for Mambo's," a pattern three kernel, "no 
match for Mambo's" is a predicate noun cluster. 



Table 6. Transformation of original sentences into kernel elements. 



Original Sentence 




Derived Kernel 


Classification 


Koko killed Lester. 


(Koko killed Lester.) 


1. 


Unaltered 


Koko is king and he 


a. 


Koko is king. 


2. 


Coordinated 


killed Lester. 


b. 


He killed Lester. 






Since Koko is an expert, 


a. 


Koko is an expert. 


3. 


Subordinated 


he killed Lester. 


b. 


He killed Lester. 






Lester was killed by Koko, 


a. 


Koko killed Lester. 


4. 


Transformed 


an expert warrior. 


b. 


Koko is warrior. 








c. 


Koko is expert. 






Koko and the expert warrior 


a. 


Koko killed Lester. 


5. 


Combination 


killed Lester while he 


b. 


The warrior killed 




of arrange- 


was running. 




Lester. 




ments 1-4. 




c. 


The warrior is expert. 








d. 


Lester was running. 







The traditional version of the story, Treatment Version A, was completely 
rewritten in kernel sentence form. All kernels on the resulting "master list" 
were numbered consecutively. These numbers functioned as categories. Every 
kernel derived from a subject's reconstruction either matched a kernel on the 
master list or could be categorized into one of the following five categories. 
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1. TNM: (True inference but no match.) Example: "There was a battle and 

someone was , the winner." A glossing-over of the terminology used in the 
treatment version, or an over-fine elaboration of a fact presented in the 
treatment version. 

2. El: (Error of identification or association.) The kernel would be a 

match but a name attached to a person, group or place contained in the 
kernel is incorrectly given. 

3. EE: (Extraneous explanation.) Material interjected into the story of 

an irrelevant nature, such as "and that's all I remember about the story. 
The End." 

4. FS: (False statement.) The kernel as a whole is incorrect, and is 

contradicted by a master list kernel. 

5. FI: (False inference.) The kernel makes a dubious statement relevant 

to events in the story but is not directly contradicted by statements 
presented in the story. 

Since the information presented in the B and C versions was also contained in 
the A version, the master list of kernel elements was derived from the ver- 
sion A only. Appendix J presents an example of the rewrite procedure and 
the results of several reliability analyses. In summary, none of the inter- 
judge correlation coefficients on the number of kernel sentences rewritten 
independently by each judge was below .97. 

Dependent variables 7~19 employed in the analysis of subjects' reconstruc- 
tions were based upon the number of each of 13 parts of speech. Each word 
was classified into one of the following categories: nouns, verbs, adjec- 

tives, adverbs, pronouns, prepositions, conjunctions, determiners, noun 
modifiers, expletives, possessive pronouns, possessive nouns, and negative 
adverbs . 

Dependent variables 20 and 21 were based upon the number of different key 
words and number of total key words contained in each subject's reconstruc- 
tion. Key words were arbitrarily selected from each of the three treatment 
versions. These words tended to be ones which referred to persons, places, 
and actions described in the passages. For the most part, these words were 
either nouns, pronouns, or verbs. 

Dependent variable 22 was simply based upon the amount of time the subjects 
required to read their original treatment versions. 
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RESULTS 



Analysis of Time and Reading Rate Data 

The total number of minutes required to read the story was recorded for each 
subject. Table 7 presents the means and standard deviations for the nine groups. 



Table 7. Mean number of minutes and standard deviation required to read the 
story for each of the nine groups. 



Recall 

Method 




A 


Version 

B 


C 


Set Relations 


Mean 


19.73 


15.28 


12.25 




SD 


7.14 


6.83 


6.15 


Multiple Choice 


Mean 


19.23 


14.22 


9.02 




SD 


6.11 


3.34 


3.32 


Reconstruction 


Mean 


24.60 


15.28 


8.78 




SD 


14.08 


7.23 


3.13 



A separate 1x3 analysis of variance was performed on each of the recall 
methods. Table 8 presents the results of the analysis for the three groups 
receiving the set relations test. A significant difference was found in the 



Table 8. Analysis of variance summary table of time taken to read the story 
for groups receiving the set relations test. 





Source 


df 


MS 


F 



Versions 


2 


284.84 


6.35** 


Error within 


60 


44.83 




Total 


62 







**p<.01 
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mean number of minutes required to read the three different versions. Indi- 
vidual comparisons by means of the Tukey (a) Test showed that subjects read- 
ing versions B and C required significantly (p^.Ol) less time than subjects 
reading version A. However, there was no significant difference between 
versions B and C. 

Table 9 presents the results of the 1x3 analysis of variance for the multiple 
choice recall method. This analysis also indicated a significant difference 



Table 9. Analysis of variance summary table of time taken to read the story 
by groups receiving the multiple choice test. 



Source 


df 


MS 


F 


Versions 


2 


521.34 


26.24*** 


Error within 


54 


19.87 




Total 


56 







***p<.001 



among the three groups in the number of minutes required to read the original 
passages. Individual comparisons by means of the Tukey (a) Test revealed 
that all groups differed significantly (p^.Ol) from each other. 

Table 10 presents the results of the 1x3 analysis of variance for the 
reconstruction test. Again the analysis indicated a significant difference 

Table 10. Analysis of variance summary table of time taken to read the story 
by groups receiving the reconstruction test. 



Source 


df 


MS 


F 


Versions 


2 


265.46 


13.85*** 


Error within 


57 


91.37 




Total 


59 






***p< .001 
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among the three ^oflps. The Tukey (a) Test revealed that all groups differed 
significantly (p^.Ol) from each other • It must be pointed out, however, 
that an analysis of variance was used for the reconstruction data, in spite 
of the rather marked differences in variances. The decision to use such an 
analysis was based on the results of the Norton study (Lindquist, 1953) in 
which it was concluded that there is a small effect of marked heterogeneity 
of variance which can be compensated for by using a slightly higher level 
of significance. Since the above F value was significant beyond the .001 
level, it was assumed that, though the actual level was somewhat lower, the 
groups did differ significantly from each other. 

An estimate of the reading rate for each subject was computed by dividing 
the total number of words contained in his assigned version by the total 
number of minutes required to read the version. Table 11 presents the mean 
number of words read per minute for the nine groups. 



Table 11. Mean number of 
each of the nine groups. 


words 


per minute read and 


standard deviation 


for 




Recall 

Method 




A 


Version 

B 


C 


Set Relations 


Mean 


88 . 86 


75.40 


46.53 




SD 


23.18 


32.72 


23.04 


Multiple Choice 


Mean 


93.26 


70.40 


55.21 




SD 


32.55 


17.99 


14.49 


Reconstruction 


Mean 


91.56 


71.29 


59.34 




SD 


72.41 


23.44 


25.20 





Separate 1x3 analysis of variance was performed on each of the recall 
methods. Table 12 presents the results of the analysis of reading rates for 
the groups receiving the set relations test. Individual comparisons indicated 
that subjects receiving versions A and B read significantly faster (p^.Ol) 
than subjects receiving version C, but the former two groups did not differ 
significantly from each other. 

The analysis of variance of reading rate for the multiple choice recall 
method also showed significant differences among the groups receiving the 
different versions. Table 13 presents the results of this analysis. Indivi- 
dual comparisons indicated that subjects receiving version A read significantly 
faster (p^.Ol) than subjects receiving versions B and C. There was no 
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difference between the two latter versions. 



Table 12. Analysis of variance summary table of words per minute for groups 
receiving the set relations test. 



Source 


df 


MS 


F 


Versions 


2 


9,746.37 


12.28*** 


Error within 


60 


793.49 




Total 


62 







***p <.001 



Table 13. Analysis of variance summary table of words per minute for groups 
receiving the multiple choice test. 



Source 



df 



MS 



F 



Versions 


2 


7,256.09 


13.77*** 


Error within 


54 


526.87 




Total 


56 







***p< .001 



The 1x3 analysis of variance of reading rates for the groups receiving the 
reconstruction method, on the other hand, yielded a nonsignificant F ratio 
(F = 2.48, df = 2/57, p<.05). However, because of the extreme variance 
associated with the version A group, the Kruskal-Wallis was also used to 
analyze the reading rates for the reconstruction groups. The resulting H 
value of 7.73 was significant at the .05 level. The Mann-Whitney U was then 
used to make individual comparisons. Results of the individual comparisons 
indicated that subjects read version C at a significantly slower rate than 
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version A (U * 116, p^.05). None of the other comparisons was significant. 
Set Relations Data 



Table 14 presents the results of an item analysis of the set relations test 
for immediate recall. It must be pointed out, however, that the number of 
subjects within the three versions is quite limited for meaningful item analy- 
sis (n s 20, 23, and 23 for versions A, B, and C respectively). Since it is 
generally held that approximately 50 subjects is the minimum number for 
meaningful item statistics, the statistics in this analysis may be rather 
unstable. Nevertheless, it appears that the items are near the recommended 
values in difficulty and discrimination. 



Table 14. Results of the item analysis for the 20 set relations items. 



Item Statistics 


A 


Version 

B 


C 


Mean item difficulty 


.41 


.38 


.40 


Mean item discrimination 


.45 


.36 


.41 


Mean point biserial correlation 


.37 


.39 


.37 


Kuder-Richardson #20 


.67 


.63 


.69 


Standard error of measurement 


2.03 


1.86 


1.97 



Ebel (1954) recommends that items be in the mid-range of difficulty (40 to 
70 percent). Table 14 indicates that the mean item difficulty is very near 
40 percent for the three groups. Ebel also recommends that the items be 
above .30 in discrimination. All mean item discrimination values were above 
this minimal value. 

The mean point biserial correlation measures the relationship between per- 
formance on the items and total test score. For versions B and C, there are 
significant relationships between these two measures (t = 1.94, p<^.05, and 
— ^ 1*82, p^.05 respectively). For version A, the ^ value of 1.69 approaches 
the .05 level but does not exceed it. One disturbing aspect of the item 
analyses was the rather low reliability coefficients yielded by Kuder-Richard- 
son i^20 • A possible factor influencing these correlations might have been 
the relatively small number of items in the set relations test. 



30 



Table 15 presents the means and standard deviations for the 12 dependent 
variables derived from the immediate recall set relations test. Table 16 
presents the data for the same variables from the delayed recall test. 



Table 15. Means and standard deviations for the 12 dependent variables on 
the immediate recall set relations test. 



Version 

ABC 



Dependent Variable 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Nested Before the Battle 


3.32 


1.16 


2.86 


1.42 


3.41 


1.30 


Nested After the Battle 


2.74 


1.19 


2.23 


1.15 


2.41 


1.53 


Nested Total 


6.11 


1.73 


5.05 


1.68 


5.82 


2.28 


Disjunctive Before the Battle 


3.26 


1.28 


3.82 


1.09 


3.59 


1.14 


Disjunctive After the Battle 


3.58 


1.39 


3.82 


1.18 


3 . 64 


1.09 


Disjunctive Total 


6. 84 


2.29 


7.64 


1.81 


7.23 


1.85 


Total Before 


6.63 


1.77 


6.68 


1.98 


7.00 


1.80 


Total After 


6.32 


1.38 


6.09 


1.77 


6.05 


2.04 


Grand Total 


12.95 


2.64 


12.73 


2.88 


13.05 


3.02 


S Score Before 


10.00 


1.70 


9.05 


1.59 


9.82 


1.65 


S Score After 


8.84 


2.04 


8.41 


1.47 


8.77 


1.72 


Total S Score 


18.95 


2.99 


17.45 


1.95 


18.55 


2.84 



Separate 1x3 analyses of variance were computed for each of the twelve 
dependent variables in Tables 15 and 16. None of the values was significant, 
indicating that performance on the set relations test was comparable regard- 
less of the original treatment version read. No differences were observed 
among the three treatment versions on either the immediate or delayed recall 
test. Analyses of covariance were also performed on the same data, adjusting 
for reading achievement and IQ, each separately and also combined. Again, 
none of the resulting F values was significant. In fact, the analyses of 
covariance did not show increased precision. This suggests that perhaps 
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reading achievement and IQ were not correlated with criterion performance or 
there was not a linear relationship between these variables and the dependent 
variables . 



Table 16. Means and standard deviations for the 12 dependent variables on 
the delayed recall set relations test. 



Version 

ABC 



Dependent Variable 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Nested Before the Battle 


3.00 


1.20 


2.77 


1.85 


2.91 


1.51 


Nested After the Battle 


2.16 


1.39 


1.96 


1.21 


1.96 


1.21 


Nested Total 


5.16 


1.98 


4.73 


2.35 


4.86 


2.15 


Disjunctive Before the Battle 


3.26 


1.24 


3.41 


1.37 


3.23 


1.19 


Disjunctive After the Battle 


3.42 


1.17 


3.50 


1.14 


3.73 


1.24 


Disjunctive Total 


6.74 


2.16 


6.91 


1.90 


6.96 


2.19 


Total Before 


6.26 


1.59 


6.27 


2.35 


6.14 


1.73 


Total After 


5.58 


1.43 


5.46 


1.71 


5.68 


1.49 


Grand Total 


11.84 


2.27 


11.73 


3.08 


11.82 


2.84 


S Score Before 


9.58 


1.87 


9.36 


2.26 


9.68 


2.10 


S Score After 


8.90 


2.23 


8.46 


1.63 


8.23 


1.95 


Total S Score 


18.47 


3.69 


17.77 


2.99 


17.91 


3.28 



The set relations were also scored as in Dawes' study by assigning each sub- 
ject an s-score which is computed by subtracting the number of pseudo- 
discriminations (nested errors) from the number of overgeneralizations 
(disjunctive errors). In order to avoid negative values in the analysis of 
variance of the s-'scores a constant of 10 was added to each score. The sign 
test was then used to determine whether subjects had a tendency to make more 
overgeneralizations than pseudo-discriminations. Table 17 presents the number 
of subjects who had positive s-scores (more overgeneralizations) and the 
number of subjects who had negative s-scores (more pseudo-discriminations) on 
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the immediate and delayed recall tests. The results indicate that for 

Table 17. Number of subjects within each version receiving positive and 
negative s-scores on the immediate and delayed recall tests. 



Time of Recall 


A 


Version 

B 


C 


Immediate 


+4 


+1 


+5 




-13* 


-18** 


-5* 


Delayed 


+5 


+5 


+4 




-11 


-14 


-15* 



*p^.05, two-tailed 

**p^.01, two-tailed 



immediate recall, regardless of version, subjects made significantly more 
pseudo-discriminations than overgeneralizations. However, for delayed recall, 
only the subjects who read version C made significantly more pseudo- 
discriminations . 

Multiple-Choice Data 

The data from the multiple choice test were also submitted to an item analy- 
sis. Table 18 presents the results of the item analysis fcr the immediate 
recall test. Again it must be noted that these results may be unstable 
since the number of subjects is under 50 (N = 19, N = 21, and N = 22 for 
versions A, B, and C respectively). Though the mean item difficulty in 
version A falls short of the mid-range (40 to 70 percent), the mean item 
difficulty for versions B and C falls within this recommended range. Also 
the mean item discrimination is well above the recommended value of .30 
in all versions. The significant point biserial correlations for versions 
B and C (^ = 2.02 and ^ = 2.13 respectively) indicate that there is a 
relationship between a student's performance on the separate items and his 
total test score. The ^ value for version A, however, was not significant 
at the .05 level. In contrast to the set relations test, the Kuder-Richardson 
#20 coefficients indicate a moderate degree of reliability for the multiple 
choice items. 

Table 19 presents the means and standard deviations for the total number of 
correct responses, number correct on the noncommon items, and number correct 
on the common items in immediate recall. The same data are presented in 
Table 20 for the delayed recall test. Separate 1x3 analysis of variance was 
performed on each of the three dependent variables for the immediate recall 
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test and for the delayed recall test. All individual comparisons were again 
made by the Tukey (a) Test. 



Table 18. Results of the item analysis 


for the 


39 multiple choice items. 




Item Statistics 


A 


Version 

B C 



Mean Item Difficulty 


.29 


.47 


.48 


Mean Item Discrimination 


.39 


.49 


.53 


Mean Point Biserial Correlation 


.38 


.42 


.43 


Kuder-Richardson #20 


.86 


.88 


.89 


Standard Error of Measurement 


2.46 


2.65 


2.63 



Table 19. Means and standard deviations for the three dependent variables on 
the immediate recall multiple choice test. 



Version 

ABC 



Dependent Variable 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Total Number Correct 


28.63 


6.05 


23.41 


6.30 


21.52 


7.03 


Number Correct on 
Noncommon 


10.32 


2.41 


6.18 


2.04 


6.33 


2.39 


Number Correct on 
Common 


18.32 


4.16 


17.24 


4.89 


15.19 


5.16 



Table 20. Means and standard deviations for the three dependent variables 
on the delayed recall multiple choice test. 











Dependent Variable 


A 

Mean SD 


Version 

B 

Mean SD 


C 

Mean SD 



Total Number Correct 


27.32 


7. to 


23.18 


5.A6 


18.19 


9. A3 


Number Correct on 


9.26 


2.88 


6.50 


2.03 


5.00 


3.10 


Noncommon 














Number Correct on 


18.05 


5.A2 


17.00 


3.89 


13.10 


6.99 



Common 



Table 21 . prfisehts the summary of the analysis of variance for the total number 
correct on immediate recall. The results indicated a significant effect due 



Table 21. Analysis of variance summary table for total correct on the 
immediate recall multiple choice test. 



Source 


df 


MS 


F 


Versions 


2 


265,18 


'6.28** ' 


Error within 


5A 


A2..26 




Total 


56 







**p < . 01 



to the three treatment versions. Individual comparisons showed that subjects 
receiving version A performed significantly (p^.Ol) better than subjects 
receiving versions B or C. There was no difference between the B and C versions. 

Table 22 presents the results of the 1x3 analysis of variance for the noncom- 
mon items. Again, a significant difference was obtained. Individual comparisons 
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Table 22. Analysis of variance summary table for number of noncommon items 
correct on the immediate recall multiple choice test. 





Source 


df 


MS 


F 


Versions 


2 


104.13 


19.71*** 


Error within 


54 


5.28 




Total 


56 







.001 



paralleled the results obtained for total number correct. Version A differed 
significantly (p<.01) from versions B and C, while B and C did not differ 
significantly from each other. 

A 1 X 3 analysis of variance on the number of correct responses for the 
common items revealed no significant differences among the three versions on 
immediate recall (F = 2.22, ^ = 2/54, p<.12). 

On the delayed recall multiple choice test, a 1 x 3 analysis of variance 
of total correct responses revealed a significant difference (p< .01) among 
the three versions. Table 23 presents the results of this analysis. 



Table 23. Analysis of variance summary table for total correct on the delayed 
recall multiple choice test. 



Source 


df 


MS 


F 


Versions 


2 


417.85 

1 


6 . 79** 


Error within 


54 


61.52 




Total 


56 







.01 




36 



Individual comparisons revealed that subjects who read version A scored 
significantly higher (p<.05) than subjects who read version C. None of 
the other individual comparisons was significant. 

Analysis of the noncommon items on the delayed recall multiple choice test 
also revealed a significant effect among the versions. A summary of this 
analysis is presented in Table 2A. Individual comparisons showed that 



Table 2A. Analysis of variance summary table for number correct on 
noncommon items on the delayed recall multiple choice test. 



Source 


df 


MS 




F 


Versions 


2 


92.22 




12.11*** 


Error within 


5A 


7.62 






Total 


56 









***p<.001 



subjects who read version A did significantly better (p^.05) than those who 
read versions B or C. There was no difference between versions B and C. 

Analysis of variance of common items correct revealed a significant (p^.02) 
difference among the groups. This analysis is summarized in Table 25. 



Table 25. Analysis of variance summary table for number of common items 
correct on the delayed recall multiple choice test. 





Source 


df 


MS 


F 


Versions 


2 


136.90 


A. 23* 


Error within 


5A 


32.38 




Total 


56 









*p<.05 



o 

ERIC 

MjlMlMiirifaiJ 
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Individual comparisons revealed that subjects who read versions A and B 
made significantly (p^,05) more correct responses than subjects who road 
version C. However, subjects reading versions A and B did not differ 
significantly from each other. 

Reconstruction Data 



Table 26 presents the means and standard deviations for the 21 dependent 
variables developed for the purpose of assessing the subjects' immediate 
written reconstructions of the original passages. 

Separate 1x3 analyses of variance were computed in order to determine 
whether subjects receiving the three versions differed on these variables. 

Of the 21 analyses, only one yielded a significant F value. This analysis 
was based upon the number of noun modifiers used in the reconstructions. 

The summary of this analysis is presented in Table 27. While the probability 



Table 27. Analysis of variance summary table for noun modifiers on the 
immediate recall reconstruction task. 





Source 


df 


MS 


F 




Versions 


2 


128.77 


4.07* 




Error within 


57 


31.63 






Total 


59 











.05 



level of an F value equal to 4.07 is approximately .02 = 2/57) „ the 

actual probability level is somewhat greater due to the fact that there was 
heterogeneity of variance. An F max test yielded an F value of 4.88 
which exceeded the critical value of 3.06. Therefore, if the usual practice 
of doubling the actual probability value is followed, the probability is 
nearer the .04 level. Individual comparisons by means of the Tukey (a) 

Test indicated that subjects reading version C used significantly (p<.05) 
fewer noun modifiers than those reading version A. All other comparisons 
were nonsignificant. 

Table 28 presents the means and standard deviations for the 21 dependent 
variables on the delayed recall reconstruction task. Separate 1x3 
analyses of variance were computed for each variable. Of the 21 analyses, 
five yielded significant F values. The three groups differed in the total 
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Table 26. Means and standard deviations for 21 variables from the immediate 
recall reconstruction task. 



Version 

ABC 



Dependent Variable 


Mean 


SD 


Mean 


SD 


Mean 


SD 


Total Sentences 


11.55 


5.92 


12.15 


6.84 


9.05 


8.28 


Average Words per 
Sentence 


11.47 


4.59 


12.32 


3.73 


12.38 


3.77 


Kernel Elements 


29.20 


16.78 


33.95 


21.72 


23.65 


15.20 


Exact Match 


18.55 


14.50 


24.40 


16.23 


16.45 


12.33 


True Inferences 


5.35 


4.55 


4.70 


6.04 


2.90 


3.37 


Total Words 


149.15 


105.02 


165.45 


129.60 


102.40 


80.52 


Nouns 


36.70 


21.86 


40.85 


31.76 


28.15 


19.46 


Verbs 


25.40 


18.17 


29.05 


21.14 


18.45 


15.49 


Adjectives 


10.85 


7.33 


11.15 


10.26 


7.25 


4.75 


Adverbs 


7.10 


7.17 


6.95 


6.49 


4.00 


3.34 


Pronouns 


11.00 


10.82 


12.50 


9.94 


6.50 


7.40 


Prepositions 


12.90 


10.29 


14.05 


11.41 


9.55 


7.01 


Conjunctions 


10.00 


8.19 


12.25 


12.09 


7.30 


6.69 


Determiners 


11.55 


8.15 


14.85 


13.18 


9.20 


6.55 


Noun Modifiers 


7.55 


7.63 


5.45 


4.97 


2.50 


3.46 


Expletives 


.75 


.79 


1.00 


1.12 


.40 


.59 


Possessive Pronouns 


2.50 


2.54 


3.60 


3.73 


2.55 


3.30 


Possessive Nouns 


1.25 


1.58 


1.65 


3.15 


1.40 


1.46 


Negative Adverbs 


1.15 


1.46 


1.60 


1.63 


1.35 


1.60 


Different Key Words 


24.00 


14.05 


28.35 


18.56 


19.85 


12.81 


Total Key Words 


52.15 


34.81 


53.65 


39.76 


34.05 


25.47 



Table 28. Means and standard deviations for 21 variables from the delayed 
recall reconstruction task. 



Dependent Variable 


Mean 


A 

SD 


Version 

B 

Mean SD 


Mean 


C 

SD 


Total Sentences 


17.30 


9.49 


12.85 


9.71 


11.15 


4.37 


Average Words per 
Sentence 


12.58 


3.42 


12.23 


3.97 


12.10 


3.63 


Kernel Elements 


43.45 


23.09 


31.50 


22.64 


28.60 


13.48 


Exact Match 


30.95 


19.09 


21.80 


18.11 


20.15 


12.23 


True Inferences 


6.95 


5.38 


5.50 


5.05 


4.30 


3 . 64 


Total Words 


215.10 


126.16 


153.50 


111.74 


135.70 


61.74 


Nouns 


54.05 


30.11 


36.75 


25.09 


36.05 


15.65 


Verbs 


37.85 


22.47 


26.50 


19.66 


23.35 


11.02 


Adjectives 


15.45 


12.33 


10.75 


7.99 


9.90 


7.32 


Adverbs 


11.35 


9.46 


7.80 


7.98 


3.90 


2.85 


Pronouns 


15.80 


12.06 


12.15 


10.65 


9.25 


6.27 


Prepositions 


18.05 


11.87 


13.10 


11.00 


10.80 


7.47 


Conjunctions 


14.45 


10.61 


11.55 


10.31 


9.10 


5.36 


Determiners 


18.65 


12.42 


11.65 


9.46 


10.50 


6.06 


Noun Modifiers 


7.85 


5.44 


6.00 


6.59 


4.50 


4.10 


Expletives 


1.40 


1.14 


.90 


.92 


.35 


.59 


Possessive Pronouns 


3.55 


3.92 


3.50 


2.20 


2.10 


2.92 


Possessive Nouns 


1.30 


1.69 


2.25 


1.83 


1.20 


1.54 


Negative Adverbs 


1.55 


1.79 


1.40 


2.03 


1.50 


1.43 


Different Key Words 


35.85 


17.99 


26.25 


16.50 


25.85 


15.31 


Total Key Words 


68.45 


36.19 


49.50 


37.23 


47.35 


20.42 



o 
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number of words used in the reconstruction of the story. Table 29 presents 
the summary of this analysis. The F max yielded a value of A. 18 which 



Table 29. Analysis of variance summary table for total number of words 
used on the delayed recall reconstruction task. 



Source 


df 


MS 


F 


Versions 


2 


34719.20 


3.23** 


Error within 


57 


10738.54 




Total 


59 







**p< .01 



exceeded the critical value of 3.06. Since there was heterogeneity of variance, 
the actual probability level was again nearer the .04 level. Individual 
comparisons indicated that the subjects who read version A used significantly 
(p<,.05) more words than those who read version C. All other individual 
comparisons were not significant. 

Analysis of the number of nouns used in the reconstructions also yielded a 
significant F value. This analysis is summarized in Table 30. These results, 



Table 30. Analysis of variance summary table for number of nouns used on 
the delayed recall reconstruction task. 





Source 


df 


MS 


F 



Versions 


2 


2079.27 


3.50* 


Error within 


57 


593.68 




Total 


59 









*p^.05 




41 



however, must be interpreted with caution since heterogeneity of variance was 
again present (F max * 3.'^0, critical value = 3.06) and the obtained F value 
was significant at only the .05 level. Nevertheless, individual comparisons 
were performed. Subjects receiving version A used significantly (p^ .05) 
more nouns than those receiving version C. None of the other comparisons 
was significant. 

Table 31 presents the summary of the analysis of variance on the number of 
adverbs used in the subjects' reconstructions. The F max test again 



Table 31. Analysis of variance summary table for number of adverbs used 
on the delayed recall reconstruction task. 



Source 


df 


MS 


F 


Versions 


2 


277.72 


5.17** 


Error within 


57 


53.71 




Total 


59 







’^*p .01 



indicated marked heterogeneity of variance among the three groups (F max = 
11.04, critical value =* 3.06). But since the obtained ^ value was signifi- 
cant at the .01 level, doubling this value still resulted in a rather low 
probability value (.02). Individual comparisons again indicated that 
subjects receiving version A used significantly more adverbs in their 
reconstructions than those receiving version C. None of the other individual 
comparisons was significant. 

Table 32 presents the summary of the analysis of variance on the number 
of determiners. The F max test yielded an F value of 4.19 which was signifi- 
cant at the .01 level. In spite of the heterogeneity of variance, individual 
comparisons were performed. The results indicated that subjects in group 
C used significantly fewer noun determiners in their reconstructions than 
subjects in group A. None of the remaining comparisons was significant. 

Table 33 presents the summary of the analysis of variance on the number 
of expletives. Again the F max test was significant (F max = 3.78, p^.05). 
However, individual comparisons were performed and indicated that subjects 
in group C used significantly (.01) fewer expletives than subjects in 
group A. No other comparisons were significant. 
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Table 32. Analysis of variance summary table for number of determiners 
used on the delayed recall reconstruction task. 





Source 


df 


MS 


F 


Versions 


2 


389.15 


4.16* 


Error within 


57 


93.51 




Total 


59 








*p < . 05 








Table 33. Analysis of 
on the delayed recall 


variance summary table 
reconstruction task. 


for number 


of expletives used 




Source 


df 


MS 


F 


Versions 


2 


5.52 


6.67** 



Error within 
Total 



5/ 

59 



.83 



< . 01 



DISCUSSION 



Analysis of the number of minutes required to read the versions showed that, 
as expected, less time was required to read the telegraphic than the full 
text or condensed versions. With the exception of the set relation groups, 
the short telegraphic version required significantly less time to read than 
the medium telegraphic version. In all three recall conditions, the medium 
and telegraphic versions were read significantly faster than the traditional 
version. 

Examination of reading rates (wpm) revealed some interesting and unexpected 
results. The analysis of wpm among the set relation groups revealed that 
there .;as no difference in average reading rates between the traditional and 
medium telegraphic versions (88.86 wpm compared to 75. AO wpm), but there was 
a significant difference between these two versions and the short telegraphic 
version (A6.53 wpm). Comparison of reading rates among the multiple choice 
groups indicated no difference between the medium and short telegraphic 
versions, but both groups read at significantly (p<,.01) slower rates than 
the traditional version group. While the 1x3 analysis of variance was 
not significant for the reconstruction groups, the non-parametric analyses 
were. Individual comparisons of the reconstruction data revealed that sub- 
jects read version C at a significantly slower rate than version A. Version 
B was read at an intermediate rate and did not differ significantly from 
either versions A or C. 

The unexpected finding, which was most obvious among the set relation groups, 
was the marked reduction in reading speed for the group receiviri^ the short 
telegraphic version. This version was read at approximately one-half the 
rate of the traditional version^ While elimination of much descriptive 
and narrative material resulted in a significant savings in time, there was 
a reduction in reading rates for the shorter and informationally more compact 
version. 

Two possible reasons are suggested for the rather dramatic decrease in wpm 
for the short telegraphic version. First, the style of version G, which 
was essentially an outline form, may have been relatively unfamiliar to 
these subjects. Characteristically, blind children have no experience in 
seeing written ’’telegraphic" information on chalkboards or in equivalent 
tactual form, as their teachers lecture on a topic in class. Added to this 
is the fact that their teachers must practice certain time economies to compen- 
sate for the additional time they require to read and write in Braille, or 
listen to material read to thems therefore, they require little outlining 
of material read. And since the blind children in this study were just be- 
coming proficient in the use of slates and stili, it may be further hypothe- 
sized that they were inexperienced in classroom notetaking, and hence in 
reviewing "telegraphic" information for test taking purposes. Thus the 
style may have caused them to reduce their normal reading speed. Perhaps 
training with this type of material would have produced a lesser reduction 
in reading rate. Second, the decrease in wpm may be attributable to the 
compactness of information contained in the C version. This version was so 
designed that all information contained in it was necessary for a complete 



understanding of the passage. In order to read the passage with a satisfactory 
degree of understanding, subjects may have found it necessary to decrease 
their normal reading speed. It may be that subjects attempt to maintain some 
optimal information processing rate which they will i.nt voluntarily exceed. 

No significant differences among the three versions were expected with respect 
to total number of correct responses on the set relations test since the 
number of set relations was the same for all versions. However, it was hypo- 
thesized that more overgeneralization errors would occur among subjects read- 
ing version A than among subjects reading version C. Contrary to this hypo- 
thesis, the results of the analysis of variance revealed no significant 
differences among the mean s-scores. These results indicated that all groups 
made similar types of errors. 

Dawes' data and theorizing provided the basis for predicting a greater number 
of overgeneralization errors among subjects reading version A. His data 
indicated that overgeneralization errors were more common than pseudo- 
discrimination errors. Because overgeneralization errors result in a reduc- 
tion of categories or sets in the passage and because of the limitation in 
human memory, it was expected that subjects would tend to overgeneralize in 
order to reduce the informational load. This tendency was expected to in- 
crease for the longer passages. However, it may be argued that, though the 
passages differed in total length, they did not differ in the total number of 
set relations. The tendency towards overgeneralization may have been related 
only to the number of set relations contained in the passage and not affected 
by sheer length. Not only were there no differences in the number of over- 
generalization errors among the three versions, but there were significantly 
more pseudo-discrimination errors. Inspection of Table 17 reveals that four 
of the six comparisons indicated that significantly more subjects received 
negative s-scores than positive scores. 

The most disturbing aspect of the set relation items was their apparent 
difficulty. Table 15 presents the mean number of total correct responses for 
the twenty item set relations test. The mean number correct for the A, B, 
and C version groups were 12.95, 12.73, and 13.05, respectively. An expected 
chance score on this test is 10.00. In fact, when each of the above means was 
analyzed to determine whether it was significantly above chance, none of the 
resulting ^ scores was significant. These results were entirely unexpected 
inasmuch as the items had been pretested on two regular classes of normal 
seeing children in grades five and six. While the normal seeing fifth 
grade subjects had difficulty with the items, the sixth grade subjects re- 
sponded significantly above chance. On the basis of these results it was 
assumed that few blind subjects would experience difficulty in obtaining 
scores above chance. Such was not the case. The fact that significantly 
more subjects made pseudo-discrimination errors than overgeneralization errors 
may be due to a response bias rather than to any type of cognitive distortion. 
Subjects may have preferred to respond to "some" type answers rather than to 
the "all" or "none" types. Consequently, although the data obtained from the 
normal seeing subjects also indicated that significantly more pseudo-discrim- 
ination errors were made, the chance performance of the blind subjects made 
it impossible to assess the effectiveness of the treatment versions or to 



assess type of cognitive distortion. 



Analyses of the multiple choice data did reveal differences among the three 
treatment versions. For immediate recall, the results of the analysis of 
variance on the common items (items answered in all three versions) showed 
no significant difference among the groups. On the noncommon items, however, 
subjects who read version A performed significantly better than those who 
read versions B or C. This is not surprising since version A contained the 
answers to the noncommon items whereas versions B and C did not. Moreover, 
when performance on total items (noncommon and common items combined) was 
examined, the same differences were found. The differences on the total 
items were largely due to the superior performance of group A on the non- 
common items. It appears that while the information relating to the non- 
common items was not essential for a thorough understanding of the story, 
it was learned and recalled by the subjects. 



The results of the delayed recall multiple choice test were similar to the 
immediate recall test. Subjects who read version A performed significantly 
better than subjects reading versions B and G on the noncommon items. However, 
for total items, there was no difference between the A and B versions. 
Nevertheless, subjects reading version A performed significantly better than 
subjects reading version C. 

Analysis of the delayed common items produced an unexpected result. Though 
there was no difference among the three groups on immediate recall, there 
was a significant difference on delayed recall. The groups reading version 
A performed significantly better than the group reading version C. Compari- 
son of the data in Tables 19 and 20 reveals that while there was little 
change between immediate and delayed retention for versions A and B, there 
was a decrease for version C in the number of commoi> items correct on the 
delayed recall task. It is unclear why there was differential forgetting 
among the three groups on the common items. Blind children lack actual, 
visual experiences (such as may be gained through pictures and television) 
that may be necessary to "dress" written skeletal outlines with meaning. 

The material with which they dealt in this study involved wars and unfamiliar 
people, tools, ideas, and places--all of which they have been previously 
unable to "see" in pictorial form. They lack the visual imagery of the 
interrelating conflicts in the story, a fact which may have forced them to 
reduce reading speed. Perhaps, the relative lack of supplementary details in 
the short telegraphic version contributed to the decrement in delayed recall. 
While the common items could be answered on the basis of the information 
contained in each of the three versions, the supplementary information in 
the longer versions may have provided a more salient context for the recall 
of the common items. Whatever the reason for the decrement in delayed recall 
among version C subjects, there was practically no forgetting among subjects 
reading versions A and B. Regardless which dependent variable is considered, 
inspection of Tables 19 and 20 reveals surprisingly little forgetting over 
the one week interval for the A and B versions. 

Analysis of the reconstruction data revealed few significant differences among 
the t|^ree versions. This is especially true for the immediate recall data 
in which a significant difference was found in only one of the 21 dependent 
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variables, that is, the number of noun modifiers. Subjects reading version C 
used significantly fewer noun modifiers than those reading version A. How- 
ever, this result is not necessarily indicative of a telegraphic writing 
among the version C reconstructions. Rather, it is most likely due to the 
fact that version A contained almost three times as many noun modifiers as 
version C. The finding that there were no significant differences among the 
three groups in total number of sentences or average words per sentence would 
suggest that the version C subjects did not tend to write in a telegraphic 
manner to any greater extent than the other groups. 

Results of the delayed recall reconstruction data revealed a greater number 
of significant differences among the three versions. Of the 21 analyses of 
variance, five yielded significant F ratios. Analysis of the average number 
of total words used in the reconstructions indicated that version C subjects' 
reconstructions were 135.70 words in length, version A subjects' reconstruc- 
tions were 215.10 words in length. This represents a 37% increase in the 
length of version A subjects’ reconstructions over version C subjects' recon- 
structions. The greater number of nouns used in the reconstructions accounts 
to some extent for the longer version A reconstructions. Version A subjects 
employed significantly (p^.05) more nouns than version C subjects. The 
difference between version A and version B approached significance (critical 
difference = 17.69, obtained difference = 17.30), but this is not surprising 
since version A contained 409 nouns compared to 141 nouns in version C. The 
greater number of nouns in version A was due to a greater degree of repetition 
and the introduction of extraneous information. Evidently these two factors 
contributed to the greater use and perhaps availability of these words during 
delayed recall. 

The number of adverbs used during delayed reconstruction by version C subjects 
was significantly less than the number used by version A subjects. However, 
version B subjects differed neither from version A nor version C subjects. 

These results indicate a tendency among version C subjects to include less 
descriptive material in their delayed reconstructions. Since version A 
contained 5 times as many adverbs as version C, the difference between sub- 
jects receiving the two versions is not entirely unexpected. What is unex- 
pected, however, is that this difference should occur in delayed reconstruction 
and not in immediate reconstruction. While there was little difference 
between the number of adverbs used for immediate and delayed reconstructions 
for group C, grouos A and B employed more adverbs in delayed than in 
immediate reconstruction. 

Likewise, although there were no differences among the groups on the number 
of determiners used in immediate reconstruction, there were differences in 
delayed reconstruction. Again, the difference was only between groups A 
and C. As in the analysis of adverbs, group A used substantially more de- 
terminers in delayed recall than in immediate recall. There was little 
change for the other groups. In fact, version B subjects used fewer deter- 
miners in delayed reconstruction than in immediate reconstruction. Inspec- 
tion of Table 2 reveals 17 times as many determiners in version A than in 
version C. Therefore, it is not entirely surprising that version C subjects 
used determiners less frequently. Again though, it is not clear why this 
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difference was observed in delayed reconstruction and not in immediate 
reconstruction. 

Although the analysis of the number of expletives indicated a significant 
difference between groups A and G on the delayed recall reconstruction task, 
the data are not particularly meaningful in view of the relative infrequent 
occurrence of these items in the reconstructions. Table 27 reveals that 
version A subjects used an average of l.AO expletives in their reconstructions 
while version B and C subjects used an average of .90 and .35 respectively. 
There was only a total of two expletives used in version A, none in version 
B, and one in version C. 

With the exception of noun modifiers, the immediate recall reconstruction 
data revealed no differences among the three versions. The fact that there 
were no significant differences among the versions on number of kernel 
elements and exact matches is noteworthy in view of the fact that version C 
was read in one-third the time as that required for version A. That is, 
version C subjects appeared to reconstruct the story as adequately as version 
A subjects. However, a greater number of significant differences were noted 
among the versions in the delayed reconstructions. While there were no 
significant differences among the groups on number of kernels and exact 
matches, there were on total words, nouns, adverbs, determiners and expletives. 
It appeared that version C subjects included less descriptive and narrative 
material in their delayed reconstructions than version A subjects. The lack 
of this type of material undoubtedly contributed to the shorter length of 
version C subjects' reconstructions. 

For the most part, the results of all three recall conditions revealed 
little difference among the three versions with respect to the recall 
(either immediate or delayed) of the essential information contained in 
the passages. The one exception was the inferior performance of version 
C subjects on the common multiple choice items during the delayed recall 
task. However, the performance of the medium telegraphic group did not 
differ from the traditional group. In fact, none of the individual compari- 
sons of the reconstruction data revealed any significant differences between 
the traditional and medium telegraphic versions. The differences were con- 
sistently between the traditional and short telegraphic versions. The un- 
familiar style of the short telegraphic version undoubtedly contributed to 
these differences. 



CONCLUSIONS 



The results of this investigation suggest that telegraphic materials may be 
a more efficient way for braille readers to learn equivalent content of 
traditional text materials. While there were few significant differences 
among the three versions on the recall measures, there were significant 
differences among the three versions in the average number of minutes re- 
quired to read the passages. To illustrate, the multiple choice groups re- 
quired 19.23, 14.22, and 9.02 minutes to read the traditional, medium 
telegraphic, and short telegraphic versions respectively. Contrast these 
values with the number correct on the comnon multiple choice items: 18.32, 

17.24, and 15.19 for the traditional, medium, and short telegraphic versions 
respectively. In short, braille readers in this study required 53 per cent 
less time to read version C than version A, while immediate recall was only 
12 per cent less effective. These comparisons reveal the greater efficiency 
of the short telegraphic version and are typical of other such comparisons. 

It must also be pointed out however, that subjects reading the traditional 
version did remember the extraneous narrative material contaii\ed in this 
version. An implicit assumption in the early formulation of this project 
was that since the extraneous narrative and descriptive material was not 
necessary for a complete understanding of the passage, this material would 
not be recalled. Such was not the case. Furthermore, the results of the 
delayed recall of the common multiple choice items suggested that this 
extraneous information may have provided a more salient context for the 
recall of these items. 

A second quite explicit assumption was that rate of information input could 
be increased via telegraphic materials. This presumed that a blind child 
would maintain his same reading speed with telegraphic materials as with 
traditional materials. The data indicated approximately a 35-50 per cent 
reduction in wpm among the subjects reading the short telegraphic versions. 

Two possible factors may account for this reduction. The first may be 
that the subjects selected reading speeds which insured comfortable rates 
of information input and did not voluntarily exceed these rates. A second, 
and perhaps more plausible, interpretation may involve a familiarity fac- 
tor. The unique style of the telegraphic materials may have caused a re- 
duction in reading speed. The fact that reading rates were not reduced as 
much for the medium telegraphic version as they were for the short telegraphic 
version supports the latter interpretation. On the other hand, the reduc- 
tion "In wpm among subjects reading the medium telegraphic versions supports 
the former interpretation. Either interpretation may be tested rather easily. 
An auditory presentation of telegraphic and traditional materials would per- 
mit assessment of the first interpretation and familiarization training on 
telegraphic materials would permit assessment of the latter. It is quite 
possible that both factors influenced the results of this studv. 

For the most part, the results of this investigation are interpreted as 
supporting the feasibility of using telegraphic materials to increase the 
rate of learning of certain materials in braille. However, a shortcoming 
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of this study is that it has not provided an operational definition of essen- 
tial or kernel information which can be applied to existing materials. 

It is obvious that most materials are not amenable to a set relation analy- 
sis. The ultimate application of the telegraphic concept to existing 
learning materials is dependent upon the development of objective reduction 
rules whereby extraneous information may be systematically eliminated from 
traditional materials. It may be possible, for example, to develop rules 
whereby certain parts of speech are systematically discarded in much the 
same manner as are speech segments in the time compression technique. 

Further research is needed to determine the kinds of objective reduction 
rules which are possible and the effect of such reduction upon comprehension 
of existing materials. 

In summary, this investigation has demonstrated that it was possible to 
rewrite traditional materials in such a fashion that low information words, 
phrases and sentences could be eliminated without destroying the essential 
information in the materials. Furthermore, the learning and retention of 
the important information in such telegraphic materials was in almost all 
comparisons comparable to the learning and retention of the same information 
presented in traditional style. Although these results may have implications 
for the learning of prose materials by any learner, they suggest that more 
efficient learning materials may be developed for blind children. One alter- 
native to the relatively slow methods of braille material presentation com- 
monly employed in the education of visually impaired children is the prepara- 
tion of informationally compact telegraphic materials. Braille material 
presented in a telegraphic style appears to be at least as efficient as 
material presented in conventional style, and requires less time to learn. 
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SUMMARY 



The major objective of this investigation ’^as to examine the ability of bli id 
children to comprehend braille prose material presented in two condensed 
styles, "medium telegraphic" and "highly telegraphic" forms. It was hypothe- 
sized that braille material presented in telegraphic style to blind children 
would result in increased rates of comprehension in comparison to braille 
material presented in the usual traditional form. 

The feasibility of developing telegraphic learning materials was based upon 
the assumption that prose found in conventional textbooks contains many 
words and word sequences which are unnecessary for the comprehension of the 
material. Telegraphic materials were developed by eliminating unimportant 
words, phrases, and sentences from traditional textual material. 

A fictional story concerning two warring African nations was written in 
full prose, traditional style, resulting in a 1620-word passage. In order 
to operationally define the important information in the passage, the story 
was written so that the central ideas of the passage were analyzable in 
terms of basic set relations. Important information was defined as material 
which described the set relations. Unimportant information was defined as 
narrative or descriptive material which was unrelated to the set relations. 
Next, a medium telegraphic condensation of the same story (947-word passage) 
was written in traditional sentence and paragraph form, but with a 42 per cent 
reduction in narrative and background material of the original passage. And 
finally, a highly condensed version of the story was written in which the 
total number of words was reduced to 455, The style of this passage was 
similar to that of a telegram, and achieved a 72 per cent reduction of the 
original passage. 

While there was a marked reduction in the total number of words in the two 
telegraphic passages, the essential information pertaining to the set re- 
lations was the same in all three versions. The greatest absolute reduction 
among the telegraphic versions was in nouns and verbs, while the greatest 
percent reduction was in noun determiners, pronouns, prepositions and adverbs. 

A total of 210 braille readers in grades six, seven, eight, and nine were 
tested. With the exception of 12 subjects, all attended state residential 
and day school classes for visually impaired children and youth. All sub- 
jects had received formal braille instruction for four years or more. 

Approximately one-third of the subjects read the traditional passage pre- 
sented in braille, one-third read the medium length telegraphic version in 
braille, and one-third read the short telegraphic version in braille. With- 
in each group assigned to a particular version, there were three sub-groups 
assigned to one of three recall conditions: recall of set relation items, 

recall of multiple choice items, and written reconstruction of the passage. 
Recall was measured immediately after reading the assigned version and again 
one week later. Each subject was retested in the same recall condition as 
that to which he was originally assigned. 



and revealed that subjects reading the medium 

readln^thriv 7®’"®^°"= required significantly less time than subjects 

fio»nr? traditional version. However, the reading rate (wpm) was signi- 

those subjects reading the short telegraphic version than for 

revMlerf»"® ^he traditional version. Analysis of the comprehension data 
■ led few significant differences among the three groups on either imme- 
diate or delayed recall. Nevertheless, there were coLisLnt differLc^ 
^ong the groups in the recall of the narrative and descriptive material 

^c\ Wi^h "‘t' --f “8 the telegraphic versions had prLtically^r^n- 

.”tth this material, the subjects reading the traditional version con- 
taining the descriptive material were able to recall it. Few significant 
ahl ”®te observed among the three groups on the 21 dependent vari- 

the purpose of analyzing subjects' written reconstruc-^ 
tions. For immediate recall, the only significant difference was in the 

Subjects reading the short telegraphic version 
used significantly fewer noun modifiers than subjects reading the tradition- 
al version. For delayed recall, subjects reading the short telegraphic 
version used significantly fewer total number of words, nouns, adverbs, 

^rspitfortheL^d subjects reading the traditional version. 

7n rC K there were no differences among the groups 

in the number of basic kernel information units recalled. 

In general, the results of this investigation were interpreted as support- 
ipL feasibility of telegraphic learning materials. The learning and 

important information in telegra-hic materials was in al- 
most all comparisons comparable to the learning and retention of the same 
presented in traditional style. The ultimate application of 
the telegraphic concept to existing materials is dependent upon the devel- 

reduction rules whereby extraneous information may be 
systematically eliminated from traditional materials. Further research is 

^ho^P^ Since most of the recall comparisons 

^ significant differences, the preparation of informationally compact 
elegraphic material may be one alternative to the relatively slow methods 

of braille material presentation commonly employed in the education of visu- 
ally impaired children. 
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Appendix A 

Traditional Version of the Story (A) 

In the year 1800 on the continent of Africa, two unfriendly nations 
existed, the nation of Mambo and the nation of Yam. The Nile River 
separated these two nations. They often fought wars over business, with 
Yam being the richer of the two. Yam was rich in wood, ivory, leopard 
skins, ostrich feathers and eggs, baboons, and dogs. Yam traded these 
goods and foods all over the continent and became very wealthy. 

King Koko, the leader of the military minded nation of Mambo, began 

to make plans for the defeat of Yam. Koko was a military man and most of 
his subjects were brave, strong, expert warriors; no Mambo Citizens were 
merchants. They liked war so much that they often would fight another 
tribe's battles for money and glory. They never lost. 

However, Koko was getting old and his body was tired and ached 
from his numerous war wounds. If he defeated Yam, he would become 
very rich and he would control thousands of people. Koko then could 
rest his battle weary body and live in luxury enjoying very much personal 
wealth and power; he would be the most powerful ruler on the continent. 

King Koko felt that the time for war against Yam was suitable be- 
cause his Mambo warriors did not like King Lester of Yam. Lester was a 

popular ruler whose subjects loved him; he was an excellent hunter and 
warrior; ha was rich and handsome. Koko knew that his warriors would 
welcome the chance to defeat Lester. Their dislike and jealousy of 
Lester plus their greed for the wealth of Yam was more than enough 
reason for them to fight a war against Yam land. 

However, there was a small band of expert Mambo warriors who knew 
about Koko's plans and they did not like them. These Mambo warriors 



compared Koko to Lester and they decided Lester was the kind of king they 
would like to serve and they welcomed the chance to be traitors to Koko. 

As a result, they were secretly meeting with a small group of Yam merchants 
who agreed to pay them money and supply them with weapons so they could 
help defend Yam. These merchants also wanted to be trained as warriors. 
Thus the Pro Lester Union consisted of a small humber of Yam merchants 
and a small number of traitor Mambo warriors. It was a rather odd look- 
ing group with a small number of strong, fierce looking warriors trying 

f 

to teach weak, fat looking merchants how to throw spears, shoot arrows, 
and chop up an enemy with an axe. The training periods never lasted more 
than twenty minutes because the merchants became very tired and needed 
^®st. Nevertheless, these men were serious about becoming warriors 
and they vowed to fight and die to the last man for good King Lester, 
their noble ruler. 

Meanwhile, in Yam land, life was peaceful and happy as usual for 
most of the people. Lester and his followers never thought much about 
war because they were too busy trading the plentiful goods of Yam all 
®ver the continent. Most of Lester *s followers were merchants j none of 
them were expert warriors. This business made them wealthy and happy. 

Thus the stage was set. King Koko prepared his army for war and 
the most important preparation was the worship of Solmambo, the sun- 
god. The witch doctor, robed in white, looked directly into the sun 
at high noon and chanted in a low voice. All the warriors had to do the 
same and any warrior who fainted from the heat or who could not look 
into the sun was killed. This happened because the witch doctor told 
the king that the sun-god was giving him a sign as to who were the unworthy 
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warriors; since they were unworthy and would not receive divine assistance 
in battle, the witch doctor killed them. He executed fifty warriors that 
afternoon. 

The Mambo warriors then painted their faces with the blood of goats; 
this gave them courage. Although this may have given the Mambo warriors 
courage, some historians believe that it did much to frighten the enemy. 

A blood streaked face with hate filled ^es screamed and charged for 
the kill. This could scare anyone I 

Now that the warriors were ready to fight, they picked up their 
spears and climbed into their war canoes to paddle down the river to 
the land of Yam. It is interesting to point out that the paddles were 
also the spears of the warriors. These spears were medium length poles 
with wide iron tips that came to a very sharp point. These spears were 
heavy and well balanced. When thrown, it xvould fly straight to its tar- 
get. This weapon was also a club in close fighting because of its heavi- 
ness. The wide iron tip had very sharp edges $o it also was a sword 
or double edged axe. This one weapon was very valuable because of its 
many uses: a paddle, a spear, a club, a sword. 

As the war canoes came near Yam, the lookouts of King Lester 
shouted the alarm. Immediately there was confusion and noise. There 
was the unusual sound of Yam musicians beating drums, blowing ram horns, 
and shaking rattles. They were also doing a native tribal dance. This 
religious ceremony was going to chase away any evil spirits lurking about 
who might hinder or harm Lester during the battle. All the Lester Followets, 
consisting of the Yam merchants and other Yam subjects and the Pro Lester 
Union, prepared to meet the invaders. 



The traitor Mambo warriors who had joined with the Yam merchants 
to form an army came running (and some panting) to meet the invaders. 

Lester entered the battle with his camel cavalry. These warriors 
wielded sharp-edged heavy pieces of iron that could cut off an enemy's 
head with a single stroke. However, King Lester and his forces were 
losing the battle. One reason was the fact that the fat Yam merchant- 
warriors were no match for the tough expert warriors of Mambo. Lester's 
army was also small; he was outnumbered by five to one. King Lester's 
heavy iron swords were difficult to use whereas King Koko's spears 
could be used with ease in many different ways. Koko's weapon was 
simple and effective. 

Nevertheless the battle continued with the battlefield being a 
mass of men, spears, camels, swords, screams, and blood. Lester decided 
that the only way he could win would be to fight Koko in personal .combat 
and kill him. Lester saw Koko and charged at him with his sword so 
he could cut his head off. But before he could strike, Koko sent 
his spear into Lester's chest. Koko threw the spear so hard that 
it came out through Lester's back. After this the Yam warriors 
fled in terror; they became helpless cowards without their leader. 

Mambo had won the battle. 

King Koko's toothless mouth widened into a big grin and he was^ 
proud of his victory. He now was the master of seven thousand prisoners, 
two hundred thousand cattle and sheep, and the business wealth of Yam. 

As a result of this victory the original social structure of Mambo remained 
the same with the largest number of Mambo Citizens still being expert 
warriors. This was necessary because Koko needed a large military force 



to tceep the Yam inhabitants under control and to protect his new found 
wealth. 

But what of Yam? After its defeat its social structure changed; 
all the people of Yam and the traitor Mambo warriors became slaves of 
King Koko. They no longer performed the same occupations as they had 
when they were free and happy, and now all their work was for their 
new ruler. The once prosperous people of Yam were now miserable slaves 
without any pride or satisfaction in their work. 

However, there was an interesting legend which came out of this 
war. After King Koko killed King Lester, some of Lester's faithful 
subjects succeeded in rescuing his dead body and secretly burying it 
to prevent the traditional burning up of killed enemy leaders that 
the Mambo warriors liked to perform. These Yam subjects never revealed 
their deed but instead they claimed that some friendly spirits had taken 
the seriously wounded Lester away to safety so he could recover and 
return to free his people. This is known as the Lester Legend. It is 
no comfort to Koko that a rather sizable number of Yam slaves believe 
this legend and he is beginning to wonder about it himself. He feels 
certain that he killed Lester but his dead body has never been found. 

But if Koko knew about the Freedom Group, he wouldn't worry about 
the legend so much. The Freedom Group is made up of some Legend 
Believers and the traitor Mambo warriors who fought for Lester but 
really don't believe the legend. This group is secretly hiding weapons 
in the jungle, keeping the Lester Legend alive, and planning for the 
overthrow of Koko. They are very active. From time to time Koko finds 
a skull in front of his hut or a dead Mambo warrior. Shipments of goods 



to other nations often never reach their destinations. Koko's food often 
contains poison; he lost fifteen food tasters in one week; needless to 
say he has a loss of appetite. Koko is grouchy, irritable, and suspicious. 
His relation with his troops is becoming unfriendly because he blames 
them for not keening control of the slaves. He sometimes thinks they 
are plotting against him with the slaves. The future for Koko is not 
promising. Perhaps his victory was not so sweet after all. 

* * * * 

Now that you have finished reading the story, raise your hand. 
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Telegraphic Version of the Story (B) 

In the year 1800 on tie continent of Africa, two unfriendly nations 
existed, Mambo and Yam. The Nile River separated them. Yam was richer. 

King Koko began to plan the defeat of Yam. Koko was a military man; 
most of his subjects were expert warriors; none were merchants. They 
liked war and often fought another tribes' battles for money and glory. 

However, Koko was getting old. If Koko conquered Yam, he would be rich 
and control thousands of people; he could rest his body, live in luxury, en- 
joy personal wealth and power; and be the strongest ruler on the continent. 

Koko felt the time for war against Yam was suitable because his 
Mambo warriors disliked King Lester of Yam. Koko knew his warriors would 
welcome the chance to defeat Lester and his followers because of their 
dislike and jealousy of Lester plus their greed for the wealth of Yam. 

However, a small band of expert Mambo warriors disliked Koko's 
plans. These Mambo warriors compared Koko and Lester and Lester was the 
kind of king they wanted to serve; they would be traitors to Koko. As a 
result this small band of traitor Mambo warriors secretly met with a 
small group of Yam merchants who agreed to pay them money and supply 
them with weapons so they would defend Yam. The small group of Yam 
merchants also wanted to be trained as warriors. Thus, a small band 
of strong, fierce, traitor Mambo warriors and a small group of weak, 
fat merchants formed the Pro Lester Union. 

Lester and his followers never thought much about war because they 
were too busy trading the plentiful goods of Yam all over the continent. 

Most of Lester's followers were merchants ;. none were expert warriors. 



King Koko prepared his array for war and raost iraportant was the 
worship of Solraarabo, the sun-god. The witch doctor looked directly into 
the sun at high noon and chanted; all the Marabo warriors did the sarae; 
any who fainted from the heat or looked away from the sun were killed. 

The witch doctor executed fifty warriors*. The Marabo warriors also 
painted their faces with goat's blood for courage. 

Now that the Marabo warriors were ready to fight, they clirabed into 
their war canoes and paddled down the river toward Yara. The paddles were 
also the spears of the warriors. These spears were heavy and well balanced; 
they could be used as clubs in close fighting due to their heaviness. 

The wide iron tips had very sharp edges so they could also be used as a 
sword or double edged axe. 

When the war canoes approached Yara, Lester's lookouts shouted the 
alarm. Yam musicians beat drums, blew ram horns, and shook rattles while 
doing a native tribal dance. This religious ceremony was to chase away 
any evil spirits who might harm Lester during the battle. All the 
Lester Followers, consisting of all Yam merchants and other Yam subjects 
and the Pro-Lester Union prepared to meet the Invaders. 

King Lester lead his camel cavalry into the battle. However, Lester 
and his forces were losing the battle. The fat merchant warriors were 
no match for the tough expert Mambo warriors; Lester's army was outnumbered 
by five to one; Lester's cavalry wielded heavy iron swords which were 
difficult to use. Lester decided he could win only if he could fight 
Koko in personal combat and kill him. Lester charged at Koko with his 
sword but before he could strike, Koko sent his spear in Lester's chest 
with such force that it came out through Lester's back. Mambo had won 
the battle. 
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King Koko was proud of his victory; he was now the master of seven 
thousand slaves, two hundred thousand cattle and sheep, and the business 
wealth of Yam. The original social structure of Mambo remained the same 
with most of the Mambo Citizens still being expert warriors because Koko 
had to keep the Yam Citizen? under control and protect his wealth. 
However, the social structure of Yam changed; all of the Yam people 
and the traitor Mambo warriors were now slaves of King Koko. 

After King Koko killed King Lester, some of Lester's faithful 
subjects succeeded In rescuing his dead body and secretly burying It 
to prevent the traditional burning up of killed enemy leaders that the 
Mambo warriors liked to perform. These Yam subjects never revealed 
their deed but Instead they claimed that some friendly spirits had 
taken the seriously wounded Lester away to safety so he could recover 
and return to free his people.- This is known as the Lester Legend. 

It is no comfort to Koko that a rather sizable number of Yam slaves 
believe this legend and he is beginning to wonder about it himself. 

He feels certain that he killed Lester but his dead body has never 
been found. 

But if Koko knew about the Freedom Group, he wouldn't worry about 
the legend so much. The Freedom Group Is made up of some Legend 
Believers and the traitor Mambo warriors who fought for Lester but 
don't believe the legend. This group Is secretly hiding weapons in 
the jungle, keeping the Lester Legend alive, and planning for the over- 
throw of Koko. From time to time Koko finds a skull in front of his 
hut or a dead Mambo warrior. Shipments of goods to other nations often 
never reach their destinations. Koko's food often contains poison. 
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Koko is grouchy, irritable, and suspicious. His relation vith his troops 
is becoming unfriendly because he blanKiS them for not keeping control of 
the slaves. He sometimes thinks they are plotting against him with the 
slaves. The future for Koko Is not promising. Perhaps his victory was 
not sc sweet after all. 

•k k ic is 

Now that you have finished reading the story, raise your hand. 
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Short Telegraphic Version of the Story (c) 

In Africa f in 1800, the Nile River separated two unfriendly nations, 

Mambo and Yam. 

Itombo: ruled by old military man. King Koko, who planned to 

conquer Yam for its riches. 

Most subjects were expert warriors; none were merchants. 
Warriors fought other tribes * wars for money and 
glory and were greedy for Yam’s riches. 

But small group of expert Mambo warriors dislike Koko’s plan, decided to 
be traitors and serve Lester. 

Met secretly with small group of Yam merchants. 

Pro Lester Union was formed by this small group of warriors and 
small group of weak, fat Yam merchants whose purpose was to train 
to defend Yam. 

Koko prepared Mambo army for war by; 

First, worship of Solmambo, their sun-god. 

Witch doctor and warriors looked directly into sun at high 
noon and chanted; witch doctor executed fifty warriors 
who couldn't do this. 

Next, painting warriors' faces with goat's blood for courage. 

Mambo warriors, ready to fight j paddled canoes to Yam. 

Paddles could be used in many ways: spear, club, sword or double- 

edged axe because of sharp edges. 
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Lester's lookouts shouted alarm as canoes approached. 



Yam musicians beat drums, blew ram horns, shook rattles, and did 
tribal dance to chase away evil spirits who might harm Lester 
during battle. 

Lester Followers, made up of all Yam merchants and other Yam 
subjects and the Pro Lester Union, met the invaders. 

Lester led his camel cavalry into battle, but fat merchants, outnumbered 
five CO one, were no match for expert warriors. 

Heavy iron sword of Lester's people difficult to use so Lester 
decided to win by killing Koko. 

When Lester charged Koko, Koko sent his spear through Lester's 
chest, killing him and winning the battle. 

Koko, proud of victory, now owned seven thousand slaves, two hundred 
thousand cattle and sheep, and business wealth of Yam. 

Afcer battle, Mambo becomes rich but social structure remains same with 
most people being expert warriors. 

Yam changes; all Yam people and traitor Mambo warriors become 
slaves of Koko. 



But there's legend that friendly spirits have taken seriously wounded 
Lester away to recover and he will come back to free his people. 

This Lester Legend is told by his faithful subjects who secretly 
buried his dead body. 

Many Yam slaves believe this legend. 

Some of these legend believers and the traitor Mambo warriors, who 
don't believe the legend, form the Freedom Group to overthrow Koko. 
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Sometimes, Koko finds a skull In front of his hut or poison In his food. 



He Is grouchy and suspicious. 

His relation with his troops Is becoming unfriendly. 



Victory may not be so sweet after all. 

* * ★ ★ 

Now that you have finished reading the story, raise your hand. 
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Appendix D Set Relations Test Items (S>R>1) 



Read each set of two sentences and then choose the one that Is true 
and mark your answer sheet accordingly. Remember, only one of the two 
sentences If. correct. Begin Immediately. 

I. The following sentences describe life In.Mambo and Yam before the 
battle, 

1. A. All of the expert warriors belonged to the Pro Lester Union. 

B. Oniy some of the expert warriors belonged to the Pro Lester Union. 

2. A. All of the merchants were Lester Followers, 

Only some of the merchants were Lester Followers. 

3. A. Only some of the expert warriors were Hambo Citizens. 

B. All of the expert warriors were Mambo Citizens. 

4. A, Only some of the Lester Followers were Mambo Citizens. 

B. All of the Lester Followers were Mambo Citizens. 

5. A. No expert warriors were merchants. 

B. Only some of the expert warriors were merchants. 

6. A. All of the Mambo Citizens belonged to the Pro Lester Union. 

B. Only some of the Mambo Citizens belonged to the Pro Lester Union. 

7. A. Only some of the Lester Followers were expert warriors. 

B. All of the Lester Followers were expert warriors. 

8. A, Only some of the Mambo Citizens were merchants. 

B. No Mambo Citizens were merchants. 
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A, Only some niembers of the Pro Lester Union were Lester Followers. 

B. All members of the Pro Lester Union were Lester Followers. 

A. All merchants were members of the Pro Lester Union. 

B. Only some of the merchants were members of the Pro Lester Union. 

The following sentences describe life in Mambo and Yam after the 
battle. 

A. Only some of the Mambo Citizens belong to the Freedom Group. 

B. All of the Mambo Citizens belong to. the Freedom Group* 

A. All of the legend believers are slaves. 

B. Only some of the legend believers are slaves. 

A. Only some of the expert warriors are legend believers. 

B. No expert warriors are legend believers. 

A. Only some members of the Freedom Group are slaves. 

B. All members of the Freedom Group are slaves. 

A. All of the Legend Believers belong to the Freedom Group. 

B. Only some of the Legend Believers belong to the Freedom Group. 

A. All of the expert warriors are Mambo Citizens. 

B. Only some of the expert warriors are Mambo Citizens. 

A. Only some of the slaves are expert warriors. 

B. All of the slaves are expert warriors. 

A. All of the expert warriors belong to the Freedom Group. 

B. Only some of the expert warriors belong to the Freedom Group. 



Only some of the Mambo Citizens are legend believers 
No Mambo Citizens are legend believers c' 



Only some of the slaves are Mambo Citizens. 
All of the slaves are Mambo Citizens. 
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Appendix E 

Multiple Choice Test Items (M-C-2) 

With your pencil, draw a line through or circle on the answer sheet 
the phrase which best completes the sentence, either A, B, C, or D. 
Do not look back at the story, ^w begin. 

1. In 1800 two unfriendly nations existed in; 

a) South America 

b) Africa 

c) Europe 

d) Worth America 

2. These two nations often fought wars over: 

a) 0 border dispute 

b) political viewpoints 

c) business 

d) religion 

3. King Koko of Mambo was a: 

a) military minded man 

b) peace loving man 

c) a generous man 

d) a satisfied man 

4. Among Mambo 's subjects, there were very many: 

a) priests 

b) merchants 

c) warriors 

- .V 

d) sailors 
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5. Koko and his followers earned money from other tribes by: 

a) trading with them 

b) fighting their battles 

c) selling them slaves 

d) protecting their camel caravans 

6. Koko was getting old and tired so he planned: 

a) to take a vacation 

b) to defeat Yam 

c) to retire as ruler of Mambo 

d) to sign a treaty with Yam 

7. Koko would become very rich if he: 

a) signed a treaty with Yam 

b) defeated Yam 

c) sold slaves to Yam 

d) fought a war for Yam 

8. The Mambo warriors did not like King Lester of Yam because: 

a) Lester's subjects loved him 

b) Lester was an excellent hunter 

c) Lester was rich 

d) All of the above 

9. The Mambo warriors were willing to fight Yam because: 

a) They wanted the wealth of Yam 

b) They did not like any Yam citizens 

c) They wanted to live in Yam 

d) None of the above 
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A small band of Mambo warriors decided: 



a) to help Lester In case of war 

b) to reveal Koko's plans to Lester 

c) to trade with some Yam merchants 

d) to work for peace 

11. The Pro Lester Union consisted of a small group of Yam merchants and: 

a) Lester's warriors 

b) Some traitor Mambo warriors 

c) Some Mambo merchants 

d) All of the above 

12. The Yam merchants of the Pro Lester Union were learning: 

a) how to become warriors 

b) how to become spies 

c) how to make weapons 

d) All of the above 

13. Most of Lester's followers were: 

a) merchants 

b) warriors 

c) union members 

d) musicians 

14. The Mambo army prepared for war by: 

a) dancing and shaking rattles 

b) painting their faces with goat's blood for courage 

c) beating drums and singing 

d) none of the above 
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15. Some historians believe that the Marabo warriors frightened their 
enemies because of: 

a) their goat-blood painted faces 

b) their terrible war cries 

c) their muscular bodies 

d) their war knowledge 

16. The Mambo witch doctor killed fifty Mambo warriors because; 

a) they were religiously unworthy 

b) they were weak 

c) they were old 

d) they were traitors 

17. The Mambo warriors had spears that were also; 

a) canoe paddles 

b) clubs 

c) swords 

d) all of the above 

18. The Mambo warriors had an advantage in the war because; 

a) they had a versatile weapon 

b) the Yam Citizens were cowards 

c) Lester was not a good warrior 

d) all of the above 

19. King Lester's lookouts announced the beginning of the war by; 

a) sending mirror signals 

b) shouting loudly 

c) setting a fire 

d) waving red flags 
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20. The Yam musicians danced and played music on seeing var canoes; 

a) To encourage King Lester's warriors for fighting 

b) To welcome the coming of the breve warriors 

c) To chase away any evil spirits that might harm Lester during 
the battle 

d) To show power and to frighten the enemy 

21. The unusual sounds of the Yam musicians as the canoes approached were; 

a) Ram horns blowing, drums beating, and rattles shaking 

b) Whistles blowing and drums beating 

c) Copper horns, drums beating 

d) Drum beats and bell ringing 

22. Lester's cavalry was; 

a) horses 

b) camels 

c) elephants 

d) donkeys 

23. King Lester's weapons were: 

a) sharp-pointed heavy daggers 

b) sharp- edged light knives 

c) sharp-pointed light arrows 

d) sharp-edged heavy pieces of iron 

24. The proportion of King tester's warriors to King Koko's warriors was; 

a) one to two 

b) five to one 

c) one to one 

d) one to five 
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25. Who was losing the battle? 

a) King Lester and his followers 

b) Lester's lookouts who used the spears 

c) King Koko and his followers 

d) Koko's warriors who used the swords 

26. King Lester's warriors were different from King Koko's warriors 
because moat were; 

a) expert warriors 

b) non- expert warriors 

c) disloyal warriors 

d) all of the above 

27. King Koko's weapons were: 

a) simple and effective 

b) heavy and complicated 

c) effective but not simple 

d) none of the above 

28. Lester's plan to get rid of Koko was to: 

a) Bribe one of Koko's warriors to kill him 

b) Ask one of Koko's servants to poison his food 

c) Fight Koko in personal combat and kill him 

d) Say religious prayers for spirits to hinder and harm Koko 

29. Lester was killed: 

a) by Koko's warriors 

b) by Koko's spear 

c) by Lester's warriors 

d) by committing suicide 
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30. Lester's followers after his death: 

a) Became more fierce 

b) Became more courageous 

c) Became hopeless cowards 

d) None of the above 

31. At the end of the battle Koko was: 

a) Unsatisfied with his victory and his new wealth 

b) Unsatisfied with his new found wealth 

c) Unsatisfied with his victory, but proud of his new found wealth 

d) Proud of his victory and his new found wealth 

32. The new found wealth of King Koko after the battle was: 

a) Seven hundred slaves and two hundred cattle and sheep 

b) Seven hundred thousand slaves and two hundred cattle and sheep 

c) Seventy slaves and two hundred thousand cattle and sheep 

d) Seven thousand slaves and two hundred thousand cattle and sheep 

33. After the battle the people of Yam were: 

a) Slaves for their new ruler 

b) More prosperous than ever 

c) Merchant warriors 

d) Unhappy but proud of their occupations 

34. Lester's dead body was burled by: 

a) Koko's warriors 

b) Lester's subjects 

c) Lester's merchants 

d) Koko's merchants 
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35. The rumor about Lester after his death was that: 

a) The doctor of King Koko was treating him of his wounds 

b) He was treated by some friendly spirits of his serious wounds 

c) . He was a guest at one of the neighboring tribes 

d) He was burned up by King Koko's warriors 

36. The rumor of Lester's return was told by: 



a) 


Lester Legend Believers 


b) 


Koko's doctor 


c) 


Neighboring tribes 


d) 


Koko's food tasters 



37. The attitude of King Koko about the rumor of Lester's return was that 
he: 



a) 


Felt indifferent since there was not too much harm in it 


b) 


Discouraged the rumor to avoid the annoyment of his slaves 


c) 


Felt uneasy about the increasing number of believers of this 
rumor 


d) 


None of the above 



38. The behavior of the Freedom Group was characterized by: 



a) 


Negotiating with other tribes to invade Koko 


b) 


Telling lies about Koko 


c) 


Planning the overthrow of Koko 


d) 


Helping slaves escape to other countries 1 



39. The relationship between Koko and his troops was; 



a) 


respect and loyalty 


b) 


friendly 


c) 


unfriendly 


d) 


none of the above 
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Appendix F 

Instruction for Reconstruction 



Write all that you can remember about the story of Mambo and 

Ybm. 

I 



o 
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Appendix G 

Data Key for Set Relations Test 



1. Subject number 

2. Sex 

3. Grade (6 thru 9) 

4. Age (Expressed in decimals) 

5. I.Q. 

6. Reading Achievement (Expressed in decimals) 

7. Time (Expressed in decimals) 

Immediate Recall 

8. Total number of correct nested items 

9. Total number of correct disjunctive items 

10. Grand total correct on all set relation items 

11. Total S score (Number correct on nested items plus twenty, minus 
number correct on disjunctive items)) 

% 

Delayed Recall 

12. Total number of correct nested items 

13. Total number of correct disjunctive items 

14. Grand total number correct on all set relation items 

15. Total S score (Number correct on nested items plus twenty, minus 
number correct on disjunctive items). 

i 
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Set Relations Test “-Original Data 



Traditional Version of the Story (A-1) 



(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 




101 


F 


8 


13.92 


123 


9.6 


19.33 




102 


M 


6 


12.75 


97 


5.2 


11.42 




103 


F 


7 


12.83 


99 


7.0 


19.00 




104 


M 


6 


11.83 


89 


7.4 


19.58 




105 


F 


9 


15.75 


104 


7.7 


15.33 




106 


M 


9 


13.50 


126 


11.9 


11.75 




107 


M 


7 


14.00 


105 


7.0 


17.17 




108 


F 


8 


13.17 




8.5 


15.25 




109 


F 


6 


10.83 


119 


6.0 


20.58 




110 


M 


7 


14.00 


104 


8.2 


19.41 




111 


F 


7 


14.67 






20.58 




112 


F 


9 


15.58 


111 




18.08 




113 


F 


9 


16.25 


96 


7.1 


22.92 




114 


F 


8 


13.75 


110 


7.3 


21.00 




115 


M 


7 


15.67 


71 


6.0 


20.42 




116 


M 


6 


12.17 


98 




19.75 




117 


M 


7 


14.50 


109 


7.9 


46.50 




118 


M 


9 








18.00 




119 


M 


8 






' 


18.83 




N=19 
















(1) 


(a) 


(9) 


(10) 


(11) 


(12) 


(13) 


(14) 


101 


7 


8 


15 


• 19 


8 


5 


13 


102 


7 


7 


14 


19 


4 


5 


9 


103 


4 


7 


11 


17 


6 


9 


15 


104 


5 


8 


13 


17 


2 


9 


11 


105 


8 


5 


13 


17 


6 


4 


10 


106 


5 


iO 


15 


15 


4 


8 


12 


107 


2 


8 


10 


14 


0 


10 


10 


108 


7 


0 


7 


27 


5 


3 


8 


109 


4 


9 


13 


15 


5 


7 


12 


110 


6 


6 


12 


20 


7 


8 


14 


111 


8 


7 


15 


21 


4 


7 


11 


112 


9 


8 


17 


21 


4 


9 


13 


113 


6 


3 


9 


23 


7 


3 


10 


114 


8 


9 


17 


19 


8 


9 


17 


115 


5 


6 


11 


19 


7 


8 


15 


116 


7 


8 


15 


19 


5 


7 


12 


117 


6 


6 


12 


20 


5 


5 


10 


118 


5 


7 


12 


20 


6 


5 


11 


119 


7 


8 


15 


18 


5 


7 


12 


N=19 

















G-2 



Telegraphic Version of the Story (B-1) 



(1) 


(2) 


(3) 


(4) 


201 


M 


9 


14.17 


202 


M 


7 


15.25 


203 


M 


7 


12.17 


204 


F 


7 


14.75 


205 


M 


6 


13.00 


206 


M 


8 


14.08 


207 


M 


8 


13.75 


208 


M 


7 


15.17 


209 


M 


6 


12.08 


210 


M 


9 


15.92 


211 


M 


7 


13.50 


212 


F 


9 


14.17 


213 


M 


6 


13.50 


214 




9 


15.00 


215 


M 


9 


13.83 


216 


M 


8 


15.00 


217 


M 


8 


13.17 


218 


F 


9 


16.25 


219 


M 


7 


13.92 


220 


M 


7 


14.33 


221 


M 


6 


13.33 


222 


F 


6 


13.92 


N=22 


(1) 


(8) 


(9) 


(10) 


201 


5 


8 


13 


202 


5 


9 


14 


203 


5 


7 


12 


204 


5 


4 


9 


205 


4 


8 


12 


206 


4 


7 


12 


207 


9 


10 


19 


208 


2 


8 


10 


209 


6 


8 


14 


210 


4 


6 


10 


211 


7 


8 


15 


212‘ 


5 


9 


14 


213 


7 


10 


17 


214 


8 


9 


17 


215 


5 


9 


14 


216 


4 


4 


8 


217 


5 


9 


14 


218 


6 


6 


12 


219 


4 


8 


12 


220 


2 


8 


10 


221 


5 


9 


14 


222 

N=22 


4 


4 


8 



(6) 


(7) 


7.9 


16.25 


5.7 


13.92 


7.9 


10.00 


7.4 


14.00 


6.0 


13.08 


9.6 


11.25 


12.0 


11.75 


7.0 


16.83 




15.75 


7.7 


19.42 


5.1 


30.58 


9.4 


6.25 




9.25 




8.92 


7.2 


14.50 




21.50 


8.2 


19.50 


6.4 


7.25 


6.7 


6.00 


6.0 


24.83 




29.50 


4.7 


15.73 



(12) 


(13) 


(14) 


(15) 


5 


6 


11 


19 


0 


6 


6 


14 


3 


7 


10 


16 


6 


4 


10 


22 


6 


5 


11 


21 


5 


8 


13 


17 


9 


8 


17 


21 


4 


10 


15 


14 


2 


5 


7 


17 


2 


8 


11 


14 


7 


8 


15 


19 


5 


9 


14 


16 


8 


8 


16 


20 


7 


8 


15 


18 


6 


8 


14 


18 


4 


4 


8 


20 


5 


7 


12 


18 


0 


10 


10 


10 


3 


7 


10 


16 


5 


4 


9 


21 


7 


8 


15 


19 


5 


4 


9 


21 



G-3 



(5) 

104 

79 

133 

91 

97 

124 

128 

100 

95 

95 

108 

140 

99 

104 

131 

72 

104 

73 

101 

88 

67 

76 

( 11 ) 

17 

16 

18 

21 

16 

18 

19 

14 

18 

18 

19 

16 

17 

19 

16 

20 

16 

20 

16 

14 

16 

20 



Short Telegraphic Version of the Story (C-1) 



(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 






301 


F 


7 


13.25 


106 


6.9 


12.92 






302 


M 


7 


13.42 


111 


7.4 


8.25 






303 


M 


6 


14.08 


75 


4.4 


23.17 






304 


M 


6 


11.17 


102 


5.6 


4.75 






305 


M 


6 


11.17 


129 


8.2 


12.58 






306 


F 


8 


13.75 


109 


9.3 


7.92 






307 


M 


8 


13.42 


110 


8.1 


13.25 






308 


M 


9 


16.92 


86 


7.5 


9.75 






309 


F 


9 


13.42 


115 


11.2 


6.50 


• 




310 


M 


7 


14.67 


121 


9.7 


13.92 






311 


M 


9 


15.17 




5.9 


14.58 






312 


F 


8 


17.33 


84 




16.33 






313 


F 


8 


15.92 


110 




8 08 






314 


F 


6 


14.17 


82 




13.17 






315 


M 


6 


13.50 


106 




11.75 






316 


F 


9 


15.67 


104 


7.5 


6.83 






317 


M 


9 


16.58 


91 


7.1 


10.58 






318 


F 


8 


16.25 


84 


6.2 


5.00 






319 


M 


8 


13.83 


132 


8.7 


5.33 






320 


M 


7 


14.08 


97 


6. 1 


15.75 






321 


F 


6 


14.25 


86 




28.67 






322 


F 


6 


13.75 


86 




21.50 






N=22 


















(1) 


(8) 


(9) 


(10) 


(11) 


(12) 


(13) 


(14) 


(15) 


301 


7 


9 


16 


18 


4 


9 


13 


15 


302 


7 


8 


15 


19 


7 


9 


16 


18 


303 


5 


9 


14 


16 


5 


8 


13 


17 


304 


7 


7 


14 


20 


8 


9 


17 


19 


305 


6 


7 


13 


19 


4 


9 


13 


15 


306 


2 


9 


11 


13 


4 


6 


10 


18 


307 


9 


9 


18 


20 


5 


9 


14 


16 


308 


2 


8 


10 


14 


4 


6 


10 


18 


309 


6 


9 


15 


17 


7 


7 


14 


20 


310 


7 


6 


13 


21 


4 


4 


8 


20 


311 


9 


5 


14 


24 


6 


3 


9 


23 


312 


2 


8 


10 


14 


2 


8 


10 


14 


313 


7 


8 


15 


19 


8 


4 


12 


24 


314 


7 


8 


15 


19 


1 


9 


10 


12 


315 


3 


7 


10 


16 . 


5 


4 


9 


21 


316 


7 


7 


, 14 


19 


5 


8 


13 


17 


317 


10 


8 


18 


22 


8 


5 


13 


23 


318 


3 


2 


5 


21 


2 


3 


5 


19 


319 


5 


7 


12 


18 


4 


8 


12 


16 


320 


5 


8 


13 


17 


6 


9 


15 


17 


321 


6 


7 


13 


19 


1 


9 


10 


12 


322 


6 


3 


9 


23 


7 


7 


14 


20 


N=22 












G-4 







ERIC 



Appendix H 





Data Key for Multiple Choice Test 


1. 


Subject number 


2. 


Sex 


3. 


Grade (6 thru 9) 


4. 


Age (Expressed in decimals) 


5. 


I.Q. 


6. 


Reading Achievement (Expressed in decimals) 


7. 


Time (Expressed in decimals) 



Imme d ia te Reca 1 1 



8. 


Total number of correct responses 


9. 


Total number of correct responses on those items which are not 
necessarily answerable from information provided in every version 
of the story. 


10. 


Total number of correct responses on those items which are definitely 
answerable from information provided in every version of the story. 



Delayed Recall 



11. 


Total number of correct responses 


12. 


Total number of correct responses on those items which are not 
necessarily answerable from information provided in every version 
of the story. 


13. 


Total number of correct responses on those items which are definitely 
answerable from information provided in every version of the story. 



H-1 

o 



Multiple Choice Test--Original Data 



Traditional Version of the Story (A- 



(1) 


(2) 


(3) 


401 


M 


6 


402 


M 


8 


403 


M 


8 


404 


F 


6 


405 


F 


7 


406 


F 


7 


407 


M 


9 


408 


M 


9 


409 


M 


7 


410 


F 


6 


411 


M 


7 


412 


F 


8 


413 


F 


8 


414 


M 


9 


415 


F 


8 


416 


M 


8 


417 


M 


8 


418 


M 


8 


419 


M 


8 


N=19 


(1) 


(8) 


(9) 


401 


13 


6 


402 


20 


7 


403 


34 


11 


404 


27 


9 


405 


35 


11 


406 


30 


12 


407 


27 


9 


408 


31 


13 


409 


37 


15 


410 


23 


7 


411 


33 


12 


412 


26 


9 


413 


35 


12 


414 


29 


10 


415 


32 


14 


416 


29 


11 


417 


29 


10 


418 


21 


8 


419 

N=19 


33 


10 



(4) 


(5) 


(6) 


14.92 


66 


3.8 


15.83 


115 


6.4 


13.75 


124 


10.6 


10.08 


128 


7.5 


12.33 


83 


5.6 


12.83 


97 


9.0 


16.08 


100 


8.2 


14.17 


115 


10.4 


13.83 






15.75 


80 




13.17 


119 


6.1 


14.17 


86 




13.58 


122 




14.75 


109 


8.7 


13.75 


146 


7.9 


i4 . 00 


106 


7.2 


14.67 






14.67 







(10) 


(11) 


(12) 


7 


5 


2 


13 


29 


9 


23 


33 


11 


18 


29 


10 


24 


33 


11 


18 


33 


13 


18 


22 


9 


18 


32 


13 


22 


35 


13 


16 


23 


10 


21 


31 


10 


17 


15 


5 


23 


34 


9 


19 


30 


8 


18 


34 


13 


18 


25 


7 


19 


28 


8 


13 


19 


7 


23 


29 


8 



o 



(7) 

18.50 
20.92 

15.00 

13.25 

20.00 

24.00 

32.00 

21.50 
15.67 

16.25 

29.17 

10.75 

14.50 

28.00 

19.17 

15.50 

19.50 

22.75 

9.00 



(13) 

3 

20 

22 

19 
22 

20 
13 

19 
22 
13 
21 
10 
25 
22 
21 
18 

20 
12 
21 



1 



Telegraphic Version of the Story (B-2) 



(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


501 


F 


8 


14.00 


109 


10.6 


8.25 


502 


M 


6 


13.58 


99 


6.4 


15.50 


503 


M 


7 


12.58 


123 


8.7 


15.75 


504 


F 


7 


14.33 


79 


5.9 


11.92 


505 


M 


9 


14.42 


121 


9.8 


17.42 


506 


F 


9 


15.83 


119 




22.42 


507 


F 


8 


13.33 


113 




12.67 


508 


F 


7 


12.00 


104 


4.9 


14.33 


509 


M 


7 


14.25 


94 


5.8 


11.58 


510 


M 


6 


12.08 


113 




9.25 


511 


F 


7 


13.33 


90 


6.1 


13.17 


512 


M 


9 


16.42 


103 


7.9 


14.25 


513 


M 


9 


16.75 


94 


7.5 


15.83 


514 


F 


8 


13.75 


104 




11.33 


515 


M 


7 


15.17 


97 


5.3 


15.00 


516 


F 


7 


12.92 


92 


6.4 


16.50 


517 


M 


6 


12.75 


93 


5.0 


16.50 



N=17 



(1) 


(8) 


(9) 


(10) 


(11) 


(12) 


(13) 


501 


31 


9 


22 


28 


6 


22 


502 


24 


6 


18 


24 


7 


17 


503 


24 


9 


15 


27 


9 


18 


504 


19 


4 


15 


22 


5 


17 


505 


31 


10 


21 


33 


11 


22 


506 


28 


7 


21 


30 


7 


23 


507 


10 


4 


6 


15 


6 


9 


508 


21 


6 


15 


24 


7 


17 


509 


13 


3 


10 


13 


1 


12 


510 


26 


6 


20 


26 


8 


18 


511 


31 


7 


24 


28 


6 


22 


512 


20 


7 


13 


22 


6 


16 


513 


28 


6 


22 


19 


5 


14 


514 


26 


5 


21 


19 


5 


14 


515 


19 


4 


15 


16 


3 


13 


516 


18 


4 


14 


25 


9 


16 


517 


29 


8 


21 


23 


4 


19 



N=17 



H-3 




A 



Short Telegraphic 



(1) (2) (3) 



601 


F 


7 


602 


M 


7 


603 


M 


8 


604 


M 


6 


605 


F 


8 


606 


F 


9 


60" 


M 


9 


608 


M 


7 


609 


F 


6 


610 


M 


6 


611 


M 


7 


612 


F 


9 


613 


F 


8 


614 


F 


9 


615 


M 


9 


616 


M 


8 


617 


M 


8 


618 


M 


7 


619 


F 


6 


620 


M 


6 


621 


F 


7 


N=21 


(1) 


(8) 


(9) 


601 


12 


2 


602 


24 


7 


603 


22 


8 


604 


30 


7 


605 


29 


7 


606 


17 


6 


607 


27 


10 


608 


14 


3 


609 


13 


4 


610 


22 


6 


611 


27 


10 


612 


24 


7 


613 


17 


6 


614 


30 


9 


615 


33 


10 


616 


13 


6 


617 


32 


8 


618 


19 


6 


619 


20 


5 


620 


15 


3 


621 


12 


3 


N=21 







of the Story (C-2) 



(5) 


(6) 


(7) 


103 


6.0 


18.33 


113 


8.2 


6.92 


91 


6.4 


6.75 


111 


6.6 


7.58 


103 


10.1 


7.00 


86 


8.3 


11.99 


100 


8.3 


7.50 


92 


5.5 


7.58 


123 




10.25 


80 




9o25 


101 


5.1 


7.00 


104 


9.1 


9.58 


91 




9.67 


130 


9.9 


8.25 


150 


8.2 


6.42 


86 


6.7 


5.75 


106 


6.8 


6.42 


105 


6.2 


10.67 


112 




17.50 


117 


7.3 


9.25 


97 


5.9 


6.67 



(11) 


(12) 


(13) 


11 


3 


8 


31 


9 


22 


22 


5 


17 


23 


6 


17 


23 


4 


19 


13 


3 


10 


27 


8 


19 


12 


3 


9 


11 


4 


7 


21 


7 


14 


23 


4 


19 


24 


9 


15 


10 


3 


7 


28 


9 


19 


30 


10 


20 


9 


5 


4 


29 


8 


21 


19 


4 


15 


18 


3 


15 


0 


0 


0 


0 


0 


0 



H-A 



Version 

(4) 

12.75 

12.75 

15.25 

11.83 

14.58 

16.33 

14.42 

14.83 

12.00 

14.67 

13.33 

14.58 

14.83 

14.42 

14.58 

15.17 

13.25 

12.08 

13.92 

12.83 

12.58 

( 10 ) 

10 

17 

14 

23 

22 

11 

17 

11 

9 

16 

17 

17 

11 

21 

23 

7 

24 

13 

15 

12 

9 



Appendix I 

Data Key for Reconstruction Test 



1. 


Subject number. 




2. 


Sex 




3. 


Grade (6 thru 9) 




4. 


Age (Expressed in decimals) 




5. 


I.Q. 




6. 


Reading Achievement (Expressed in decimals) 




7. 


Time (Expressed in decimals) 




Immediate Recall 




8. 


Total number of sentences 




9. 


Average number of words per sentence 




10. 


Number of kernel elements as rewritten by the experimenter 


11. 


Number of exact matches as rewritten by the experimenter 
to one of the 331 kernels of the traditional version of 

i 


and matched 
the story. 


12. 


Number of true inferences but not actually matched to a 
kernel. (TNM) 


particular 


13. 


Total number of words 




14. 


Nouns 




15. 


Verbs 




16. 


Adjectives 




17. 


Adverbs 




18. 


Pronouns 




19. 


Prepositions 




20. 


Conjuctions 




21. 


Determiners 





I-l 



22 . 



Noun Modifiers 



23. 


Expletives 


2A. 


Possessive Pronouns 


25. 


Possessive Nouns 


26. 


Interjections 


27. 


Negative Adverbs 


28. 


Number of different key words found in the subjects as matched 
to a list of key words which were selected from the corresponding 
A, B, or C version of the original passages. 


29. 


Total number of key words 



Delayed Recall 



30. 


Total number of sentences 


31. 


Average number of words per sentence 


32. 


Number of kernel elements as rewritten by the experimenter 


33. 


Number of exact matches as rewritten by the experimenter and 
matched to one of the 331 kernels of the traditional version 
of the story. 


34. 


Number of true inferences but not actually matched to a 
particular kernel (TNM). 


35. 


Total number of words 


36. 


Nouns 


37. 


Verbs 


38. 


Adjectives 


39. 


Adverbs 


40. 


Pronouns 


41. 


Prepositions 


42. 


Conjunctions 


43. 


Determiners 


44. 


Noun Modifiers 



o 



1-2 



A5. Expletives 
A6. Possessive Pronouns 
A7. Possessive Nouns 
A8. Interjections 
A9. Negative Adverbs 

50. Number of different key words found in the subjects writing as 
matched to a list of key words which were selected from the 
corresponding A, B, or C versions of the original passages. 

51. Total number of key words 



Reconstruction Test--Original Data 



Traditional Version of the Story (A-3) 



(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 




701 


M 


7 


14.00 






16.00 




702 


M 


7 


14.00 


86 


4.8 


4.33 




703 


M 


6 


11.83 


104 


3.2 


68.25 




704 


F 


9 


15.17 


93 


9.1 


17.33 




705 


M 


7 


12.00 


130 


10.5 


20.92 




706 


F 


9 


14.33 


120 


6.0 


20.00 




707 


F 


6 


12.75 


86 


7.2 


30.42 




708 


F 


8 


14.42 




5.3 


31.83 




709 


F 


8 


14.08 


85 


8.0 


13.83 




710 


F 


7 


13.67 


95 


5.1 


25.83 




711 


M 


8 


13.17 


122 


8.5 


29.50 




712 


M 


9 


13.92 


107 


7.4 


21.92 




713 


M 


9 


14.83 


108 




13.25 




714 


F 


9 


15.83 


127 


9.5 


16.92 




715 


F 


8 


12.92 


119 


6.7 


15.00 




716 


M 


8 


14.92 


101 


8.7 


48.25 




717 


M 


7 


15.50 


85 


5.8 


26.50 




718 


F 


7 


14.42 


98 


5.7 


16.42 




719 


M 


6 


14.67 


69 




15.00 




720 


M 


6 


13.92 


101 




40.50 




N=20 
















(1) 


(8) 


(9) 


(10) 


(11) 


(12) 


(13) 


(14) 


701 


4 


6.5 


13 


10 


3 


26 


10 


702 


6 


8.5 


15 


9 


4 


51 


15 


703 


1 


2.0 


4 


2 


2 


20 


7 


704 


10 


16.1 


35 


13 


12 


161 


38 


705 


7 


14.7 


26 


20 


6 


103 


31 


706 


23 


14.9 


64 


58 


3 


343 


89 


707 


16 


11.6 


38 


28 


8 


186 


46 


708 


11 


16.7 


31 


16 


9 


183 


38 


709 


11 


12.8 


25 


5 


8 


141 


37 


710 


26 


7.5 


42 


33 


7 


195 


57 


711 


11 


7.6 


24 


18 


1 


83 


28 


712 


11 


14.3 


35 


22 


9 


163 


49 


713 


18 


10.2 


38 


32 


4 


183 


43 


714 


30 


15.8 


97 


66 


14 


473 


109 


715 


21 


17.8 


70 


60 


7 


373 


82 


716 


12 


11.7 


37 


33 
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Appendix J 
Rewrite Procedure 

The rewrite procedure consisted of rewriting the subjects' reconstruc- 
tions into kernel sentences and then matching the kernels with the master 
kernel list derived from version A. 

The first task in rewriting a subject's reconstruction was the identi- 
fication of the noun and verb phrases. Since a kernel sentence consists 
of a noun and verb phrase, identification of such phrases permitted further 
identification of the subordinated or coordinated kernels. In addition, 
all words and word clusters were categorized into noun, verb, adjectival or 
adverbial form classes. This facilitated the identification of noun and 
verb phrases which could be rewritten into kernel elements. Table J.l 
presents the kernel sentence analysis of a reconstruction written by S 187, 
Form class words and word clusters are labeled and the verb phrase of each 
kernel underlined. 

Table J.2 presents the kernel sentences which were derived from the 
material presented in Table J.l. Each kernel sentence which could be 
matched to a kernel sentence on the master list is preceded by the number 
of the master list kernel. 

Kernels which could not be matched to any on the master list were 
labeled according to one of the five categories defined in the Methods 
Chapter. Subject 187 's reconstruction contained two such kernels. 
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Table J.l. Grammatical analysis of a subject's reconstruction. 



N V ADV 

When the battle had gone on for a while King Lester saw that they were los- 

Ni V N2 V ADJ 

ing even though they had sharp-edged pieces of iron that could cut off the enemy's 

N 2 ADV V N 2 ADJ 

head with one stroke. The men of Mambo outnumbered the Yam men five to one. 

Ni V N 2 

King Lester decided that (if he was to win the war) he would have to do 

Ni V N 2 ADJ N 2 V 

personal battle with Koko. Just as Lester thrf w his weapon Koko's spear went 

ADJ N 2 V N 2 V N 2 

into Lesters chest . The spear went through his chest and came out of his back 

V N2 

and Mambo won the battle. 



Table J.2. Rewritten kernels from subject's original reconstruction and 
master list kernel numbers. 



12 Lester saw that they were losing. 

23 The battle had gone on for a while. 

6 They had pieces of iron. 

7 Pieces were sharp-edged. 

9 Pieces could cut off head. 

10 Head was enemy's. 

11 Pieces could cut off head with one stroke. 

16 Men of Mambo outnumbered men of Yam. 

17 Men of Mambo outnumbered men of Yam five to one. 

30 King Lester decided (if he was to win war) he would 
have to do personal combat with Koko. 

FS Lester threw his weapon. 

38 Spear went into chest. 

39 Chest was Lester's. 

36 Spear was Koko's. 

TNM Spear went through his chest. 

A1 Spear came out of his back. 

A8 Mambo won the battle. 



ir 



The following material is an excerpt from version A upon which a por- 
tion of the reconstruction was based. 

Nevertheless the battle continued with the battlefield 
being a mass of men, spears, camels, swords, screams, and 
blood. Lester decided that the only way he could win 
would be to fight Koko in personal combat and kill him. 

Lester saw Koko and charged at him with his sword so he 
could cut his head off. But before he could strike, Koko 
sent his spear into Lester's chest. Koko threw the spear 
so hard that it came out through Lester's back. After 
this the Yam warriors fled in terror; they became helpless 
cowards without their leader. Mambo had won the battle. 

The following kernels were selected from the master list of kernels 

and represent the corresponding matches indicated in Table J.2. 

1. Traitor Mambo warriors came running. 

2. Some warriors came panting. 

3. Warriors came to meet the invaders. 

A. Lester entered battle. 

5. Lester entered with camel cavalry. 

6. Warriors wielded pieces of iron. 

7. Pieces were sharp edged. 

8. Pieces were heavy. 

9. Pieces could cut off head. 

10. Head was enemy's. 

11. Pieces could cut off with single stroke. 

12. Lester was losing battle. 

13. (Lester's) forces were losing battle. 

lA. Reason was fact that Yam warriors were no match for Mambo' s. 

15. Lester's army was small. 

16. Lester's army was outnumbered. 

17. Army was outnumbered five to one. 

18. Lester's swords were difficult to use. 

19. Koko's spears could be used with ease. 

20. Koko's spears could be used in many ways. 

21. Koko's weapon was simple. 

22. Koko's weapon was effective. 

23. Battle continued. 

2A. Battlefield was mass of men. 

25. Battlefield was mass of spears. 

26. Battlefield was mass of camels. 

27. Battlefield was mass of swords. 

28. Battlefield was mass of screams. 

29. Battlefield was mass of blood. 

30. Lester decided that way to win would be to 

fight Koko in personal combat. 

31. Lester decided that way to win would be to kill Koko. 

32. Lester saw Koko. 



33. 


Lester charged at him. 




34. 


Lester charged with his sword. 




35. 


Lester charged so he could cut his head 


off. 


36. 


Koko sent his spear. 




37. 


Koko sent his spear before Lester could 


strike. 


38. 


Koko sent his spear into chest. 




39. 


Chest was Lester's. 




40. 


Koko threw his spear so hard. 




41. 


Spear came out through back. 




42. 


Back was Lester's. 




43. 


Yam warriors fled after this. 




44. 


Yam warriors fled in terror. 




45. 


Yam warriors became cowards. 




46. 


Cowards were helpless. 




47. 


Yam warriors became cowards without their leader. 


48. 


Mambo had won the battle. 





In spite of the relative complexity of this scoring procedure, it did 
yield rather high inter- judge reliability estimates. The reconstructions of 
15 randomly chosen subjects were each rewritten into kernel form by three 
independent judges. The subjects were then ranked on the basis of the total 
number of kernel sentences. Hoyt's (1941) analysis of variance indicated 
that the reliability of this ranking was .99. The same three judges re- 
peated this procedure on a second sample of 20 different subjects and ob- 
tained a reliability coefficient of .97. 

A further analysis was performed in order to determine whether the 
judges agreed on the total number of assigned matches. Again, 20 randomly 
selected subjects were chosen and the three judges matched their kernels 
to the master list of kernels. The subjects were then ranked on the basis 
of the number of matches assigned by each judge. The reliability was de- 
termined by the Kendall coefficient of concordance which yielded a W value 
of .91. 

These results indicated that this scoring procedure resulted in a 

fairly high degree of agreement among judges on total number of kernel 
elements and total number of matches. 
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